Data Engineering Resources

Redefining Ethical Web Scraping in the Wake of the Generative AI Boom

The article explains the essence of ethical web data collection, best practices, key challenges, and discussions that the AI boom has sparked in recent years.

December 19, 2024

by Karolis Didziulis

· 4,655 Views · 1 Like

Zero Trust for AI: Building Security from the Ground Up

Zero-trust AI takes a proactive approach to security, protecting your data, workflows, and systems to keep everything safe and reliable.

December 18, 2024

by Josephine Eskaline Joyce

CORE

· 5,683 Views · 4 Likes

Foundational Building Blocks for AI Applications

This article explores how industries can build, utilize, and implement AI solutions, and provides an in-depth look at technical implementation strategies.

December 18, 2024

by Anuja More

· 3,930 Views

Managing Orphaned Users in SQL Server: A Comprehensive Guide

Effectively managing orphaned users within SQL Server is imperative for ensuring database security and efficient administration.

December 18, 2024

by arvind toorpu

CORE

· 6,420 Views · 2 Likes

Key Considerations for On-Premise to Cloud Data Warehouse Migration

Migrating your on-premise data warehouse to the cloud requires thorough planning. This article will help in the decision-making process by addressing critical factors.

December 18, 2024

by Maria Anurag Reddy Basani

· 6,192 Views

Delta Live Tables in Databricks: A Guide to Smarter, Faster Data Pipelines

Delta Live Tables (DLT) in Databricks streamlines data pipelines, enhancing data quality, simplifying pipeline management, and enabling real-time data processing.

December 18, 2024

by Kiran Polimetla

· 8,408 Views · 2 Likes

A Comprehensive Guide to Prompt Engineering

Master prompt engineering for optimal AI results. Use the CSIR formula and best practices, such as being specific, stating your intent, and directing the output format.

December 18, 2024

by Narendra Babu Mundlamuri

· 6,877 Views · 2 Likes

Managing AWS Managed Microsoft Active Directory Objects With AWS Lambda Functions

In this tutorial, you will learn to manage AWS Managed Microsoft Active Directory objects with AWS Lambda Functions with code examples.

December 17, 2024

by Avik Bose

· 6,867 Views

Deploying LLMs Securely With OWASP Top 10

The OWASP Top 10 guide lays out best practices for securely implementing GenAI applications that rely on LLMs.

December 17, 2024

by Nigel Douglas

· 6,896 Views · 1 Like

How to Optimize Edge Devices for AI Processing

Desiging for edge AI is crucial in today's world with on-device processing and AI applications increasing in popularity.

December 17, 2024

by Emily Newton

· 5,092 Views · 1 Like

Implementing OneLake With Medallion Architecture in Microsoft Fabric

This guide to Microsoft OneLake covers structured layers and security, enabling high-quality data optimization for analytics.

December 17, 2024

by Aravind Nuthalapati

CORE

· 25,321 Views · 3 Likes

Mastering Back-End Design Patterns for Scalable and Maintainable Systems

Learn how back-end design patterns can simplify development, enhance scalability, and make your codebase cleaner, testable, and easier to maintain.

December 17, 2024

by Gautam Solaimalai

· 3,380 Views · 5 Likes

Configuring Autoscaling for Various Machine Learning Model Types

This tutorial helps explore options for choosing the right autoscaling policy for maximum resource utilization using AWS Sagemaker.

December 17, 2024

by Koushik Balaji Venkatesan

· 10,434 Views · 6 Likes

Building a New Public API

How I built a public API from scratch: A solo developer's journey through tech choices, security challenges, and creating real value. Learn key API project strategies.

December 16, 2024

by Ollie Bannister

· 4,785 Views · 1 Like

Mainframe to Serverless Migration on AWS: Challenges and Solutions

This article provides references to resources on mainframe-to-AWS cloud migration, serverless architecture, data migration, performance, and best practices.

December 16, 2024

by Sajith Narayanan

· 11,876 Views · 4 Likes

Integrating Llama 3.2 AI With Amazon SageMaker

Implement and deploy Llama 3.2 using Amazon SageMaker for generative AI tasks like content creation, conversational agents, and personalized recommendations.

December 16, 2024

by Sunil Pradhan Sharma

· 4,799 Views · 2 Likes

Dropwizard vs. Micronaut: Unpacking the Best Framework for Microservices

Discover the best option for building efficient and scalable microservices by reading this comparison of Dropwizard and Micronaut frameworks.

December 16, 2024

by Nilesh Jain

· 17,424 Views · 6 Likes

Securing APIs in Modern Web Applications

Learn about key practices for securing APIs in modern web apps, including authentication, encryption, and monitoring, to guard against vulnerabilities.

December 16, 2024

by Michal Clarke

· 4,116 Views · 2 Likes

Launching Pega Web Mashup Forms on a Secure Static Website With AWS S3

Learn how to configure and deploy Pega Web Mashup forms on a static website hosted in an AWS S3 bucket for seamless user access and simplified infrastructure.

December 16, 2024

by Sridevi Kakolu

· 3,151 Views · 10 Likes

Which Flow Is Best for Your Data Needs: Time Series vs. Streaming Databases

While both are used to handle time-related data, their underlying technologies and main purpose are built to serve different purposes.

December 13, 2024

by Gautam Goswami

CORE

· 5,732 Views · 3 Likes

The Latest Data Engineering Topics