Data Engineering Resources

Convert Stored Procedures and Functions From SQL Server to PostgreSQL

This article explains key differences in stored procedures and functions syntax in SQL Server and PostgreSQL, and basic steps to convert T-SQL code into PL/pgSQL.

February 20, 2025

by Vlad Bilyak

· 5,620 Views

Scaling Image Deduplication: Finding Needles in a Haystack

Learn to efficiently deduplicate 100M+ images using distributed architectures, embeddings, FAISS for ANN search, and clustering to ensure accurate results.

February 20, 2025

by Praneeth Reddy Vatti

· 5,982 Views · 3 Likes

An Introduction to Object Mutation in JavaScript

In this article, you will learn how object mutation in JavaScript works, its pitfalls, and strategies to prevent it with relevant code examples.

February 20, 2025

by Joydip Kanjilal

CORE

· 5,960 Views

How to Use Terraform Import Block for Importing Resources

With Terraform 1.5 and later, you can use the import block to manage the import of resources directly in your configuration.

February 19, 2025

by Mariusz Michalowski

· 5,202 Views · 2 Likes

Data Pattern Automation With AI and Machine Learning

Pattern recognition and AI improve data workflows, automate insights, and drive efficiency in business processes across industries.

February 19, 2025

by Sandip Gami

· 4,287 Views · 2 Likes

The Impact of Edge Computing on Mobile App Development

Edge computing impacts mobile app development through enhanced privacy, updated AI opportunities, and increased innovation. Here's how.

February 19, 2025

by Zac Amos

· 3,098 Views

Build Scalable GenAI Applications in the Cloud: From Data Preparation to Deployment

Learn key considerations around data preparation, model fine-tuning, deployment strategies, and ethical AI to prepare you to build scalable GenAI applications.

February 19, 2025

by Aravind Nuthalapati

CORE

· 31,368 Views · 2 Likes

Observability and DevTool Platforms for AI Agents

Check the platforms that provide developers with powerful tools to monitor, debug, and optimize AI agents, ensuring their reliability, efficiency, and scalability.

February 19, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 17,721 Views · 5 Likes

Agentic Workflows for Unlocking User Engagement Insights

Learn how to generate actionable insights by having agentic workflows deployed on your user engagement data with the help of CrewAI.

February 19, 2025

by Pavan Vemuri

CORE

· 4,154 Views · 10 Likes

Streamline Microservices Development With Dapr and Amazon EKS

Learn how the combination of Dapr and Amazon EKS accelerates development, enhances applications' resilience, and improves scalability.

February 19, 2025

by Jatinder Singh

· 7,124 Views

The Recursive Prerequisite [Comic]

Interviewing for a new developer job? You may want to brush up on your knowledge of Quicksort (and recruiting).

February 19, 2025

by Daniel Stori

CORE

· 4,402 Views · 4 Likes

Building Intelligent Microservices With Go and AWS AI Services

The development of intelligent applications has seen exponential growth since the convergence of Microservices architecture and cloud-based AI services.

February 18, 2025

by Sairamakrishna BuchiReddy Karri

· 4,995 Views · 2 Likes

Data Privacy and Governance in Real-Time Data Streaming

Real-time data streaming delivers fast insights but raises privacy and compliance risks. Use encryption, tokenization, and policy enforcement for secure streaming.

February 18, 2025

by Murugan Lakshmanan

· 3,707 Views · 1 Like

Dive Into Tokenization, Attention, and Key-Value Caching

This article covers how key-value caching works and how it helps optimize large language models. It includes a text generation process to make it easy to understand.

February 18, 2025

by Kailash Thiyagarajan

· 5,392 Views · 1 Like

Creating an Agentic RAG for Text-to-SQL Applications

Agentic RAG simplifies text-to-SQL by modularizing tasks into tools like query transformation, hybrid search, and re-ranking, ensuring accuracy and scalability.

February 18, 2025

by Arjun Bali

· 10,479 Views

Implement Amazon S3 Cross-Region Replication With Terraform

Learn how to configure Amazon S3 Cross-Region Replication using Terraform to automate and streamline data redundancy, compliance, and disaster recovery setups.

February 18, 2025

by Srinivas Chippagiri

CORE

· 19,120 Views · 1 Like

Container Checkpointing in Kubernetes With a Custom API

This article discusses using a Kubernetes sidecar for container checkpointing: build, push, deploy to K8s, and trigger checkpoints via API for state management.

February 18, 2025

by VARUNREDDY DEVIREDDY

· 5,952 Views · 1 Like

The Delegated Chain of Thought Architecture

The D-CoT architecture decouples reasoning from execution in LLM by centralizing reasoning in a "modulith" and delegating execution tasks to specialized modules.

February 18, 2025

by Pier-Jean MALANDRINO

CORE

· 4,744 Views · 4 Likes

Generate Unit Tests With AI Using Ollama and Spring Boot

Run Ollama LLM locally with Spring Boot to generate unit tests for Java. Ensure data privacy, easy setup, and seamless integration with Spring AI.

February 18, 2025

by Amol Gote

CORE

· 8,357 Views · 4 Likes

Multimodal RAG With Colpali, Milvus, and VLMs

Build a multimodal RAG app with ColPali, Milvus, and a visual language model to enable Q&A on PDFs using text and visual data indexed for efficient search.

February 18, 2025

by Saumitra Srivastav

· 2,009 Views · 3 Likes

The Latest Data Engineering Topics