Data Engineering Resources

Building a Simple RAG Application With Java and Quarkus

With Java’s versatility and Quarkus’s cloud-native optimizations, you can build high-performance, scalable applications that seamlessly integrate AI-driven features.

February 21, 2025

by Daniel Oh

CORE

· 9,013 Views · 6 Likes

Solving Interface Challenges With the BFF Pattern

A BFF is a back-end service tailored to a specific user interface or experience. Instead of using one API for all platforms, each client has its own dedicated backend.

February 20, 2025

by Narendra Lakshmana gowda

· 5,185 Views · 4 Likes

AI Agents: Future of Automation or Overhyped Buzzword?

AI Agents perceive, decide, and act independently, continuously learning and adapting to automate complex tasks with minimal human intervention.

February 20, 2025

by Graziano Casto

CORE

· 4,589 Views · 2 Likes

Convert Stored Procedures and Functions From SQL Server to PostgreSQL

This article explains key differences in stored procedures and functions syntax in SQL Server and PostgreSQL, and basic steps to convert T-SQL code into PL/pgSQL.

February 20, 2025

by Vlad Bilyak

· 5,424 Views

Scaling Image Deduplication: Finding Needles in a Haystack

Learn to efficiently deduplicate 100M+ images using distributed architectures, embeddings, FAISS for ANN search, and clustering to ensure accurate results.

February 20, 2025

by Praneeth Reddy Vatti

· 5,705 Views · 3 Likes

An Introduction to Object Mutation in JavaScript

In this article, you will learn how object mutation in JavaScript works, its pitfalls, and strategies to prevent it with relevant code examples.

February 20, 2025

by Joydip Kanjilal

CORE

· 5,791 Views

How to Use Terraform Import Block for Importing Resources

With Terraform 1.5 and later, you can use the import block to manage the import of resources directly in your configuration.

February 19, 2025

by Mariusz Michalowski

· 5,135 Views · 2 Likes

Data Pattern Automation With AI and Machine Learning

Pattern recognition and AI improve data workflows, automate insights, and drive efficiency in business processes across industries.

February 19, 2025

by Sandip Gami

· 4,058 Views · 2 Likes

The Impact of Edge Computing on Mobile App Development

Edge computing impacts mobile app development through enhanced privacy, updated AI opportunities, and increased innovation. Here's how.

February 19, 2025

by Zac Amos

· 3,021 Views

Build Scalable GenAI Applications in the Cloud: From Data Preparation to Deployment

Learn key considerations around data preparation, model fine-tuning, deployment strategies, and ethical AI to prepare you to build scalable GenAI applications.

February 19, 2025

by Aravind Nuthalapati

CORE

· 31,272 Views · 2 Likes

Observability and DevTool Platforms for AI Agents

Check the platforms that provide developers with powerful tools to monitor, debug, and optimize AI agents, ensuring their reliability, efficiency, and scalability.

February 19, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 16,226 Views · 5 Likes

Agentic Workflows for Unlocking User Engagement Insights

Learn how to generate actionable insights by having agentic workflows deployed on your user engagement data with the help of CrewAI.

February 19, 2025

by Pavan Vemuri

CORE

· 4,058 Views · 10 Likes

Streamline Microservices Development With Dapr and Amazon EKS

Learn how the combination of Dapr and Amazon EKS accelerates development, enhances applications' resilience, and improves scalability.

February 19, 2025

by Jatinder Singh

· 7,021 Views

The Recursive Prerequisite [Comic]

Interviewing for a new developer job? You may want to brush up on your knowledge of Quicksort (and recruiting).

February 19, 2025

by Daniel Stori

CORE

· 4,344 Views · 4 Likes

Building Intelligent Microservices With Go and AWS AI Services

The development of intelligent applications has seen exponential growth since the convergence of Microservices architecture and cloud-based AI services.

February 18, 2025

by Sairamakrishna BuchiReddy Karri

· 4,894 Views · 2 Likes

Data Privacy and Governance in Real-Time Data Streaming

Real-time data streaming delivers fast insights but raises privacy and compliance risks. Use encryption, tokenization, and policy enforcement for secure streaming.

February 18, 2025

by Murugan Lakshmanan

· 3,590 Views · 1 Like

Dive Into Tokenization, Attention, and Key-Value Caching

This article covers how key-value caching works and how it helps optimize large language models. It includes a text generation process to make it easy to understand.

February 18, 2025

by Kailash Thiyagarajan

· 5,200 Views · 1 Like

Creating an Agentic RAG for Text-to-SQL Applications

Agentic RAG simplifies text-to-SQL by modularizing tasks into tools like query transformation, hybrid search, and re-ranking, ensuring accuracy and scalability.

February 18, 2025

by Arjun Bali

· 10,159 Views

Implement Amazon S3 Cross-Region Replication With Terraform

Learn how to configure Amazon S3 Cross-Region Replication using Terraform to automate and streamline data redundancy, compliance, and disaster recovery setups.

February 18, 2025

by Srinivas Chippagiri

CORE

· 18,983 Views · 1 Like

Container Checkpointing in Kubernetes With a Custom API

This article discusses using a Kubernetes sidecar for container checkpointing: build, push, deploy to K8s, and trigger checkpoints via API for state management.

February 18, 2025

by VARUNREDDY DEVIREDDY

· 5,860 Views · 1 Like

The Latest Data Engineering Topics