Data Engineering Resources

Build Scalable GenAI Applications in the Cloud: From Data Preparation to Deployment

Learn key considerations around data preparation, model fine-tuning, deployment strategies, and ethical AI to prepare you to build scalable GenAI applications.

February 19, 2025

by Aravind Nuthalapati

CORE

· 31,416 Views · 2 Likes

Observability and DevTool Platforms for AI Agents

Check the platforms that provide developers with powerful tools to monitor, debug, and optimize AI agents, ensuring their reliability, efficiency, and scalability.

February 19, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 18,560 Views · 5 Likes

Agentic Workflows for Unlocking User Engagement Insights

Learn how to generate actionable insights by having agentic workflows deployed on your user engagement data with the help of CrewAI.

February 19, 2025

by Pavan Vemuri

CORE

· 4,213 Views · 10 Likes

Streamline Microservices Development With Dapr and Amazon EKS

Learn how the combination of Dapr and Amazon EKS accelerates development, enhances applications' resilience, and improves scalability.

February 19, 2025

by Jatinder Singh

· 7,200 Views

The Recursive Prerequisite [Comic]

Interviewing for a new developer job? You may want to brush up on your knowledge of Quicksort (and recruiting).

February 19, 2025

by Daniel Stori

CORE

· 4,443 Views · 4 Likes

Building Intelligent Microservices With Go and AWS AI Services

The development of intelligent applications has seen exponential growth since the convergence of Microservices architecture and cloud-based AI services.

February 18, 2025

by Sairamakrishna BuchiReddy Karri

· 5,068 Views · 2 Likes

Data Privacy and Governance in Real-Time Data Streaming

Real-time data streaming delivers fast insights but raises privacy and compliance risks. Use encryption, tokenization, and policy enforcement for secure streaming.

February 18, 2025

by Murugan Lakshmanan

· 3,760 Views · 1 Like

Dive Into Tokenization, Attention, and Key-Value Caching

This article covers how key-value caching works and how it helps optimize large language models. It includes a text generation process to make it easy to understand.

February 18, 2025

by Kailash Thiyagarajan

· 5,508 Views · 1 Like

Creating an Agentic RAG for Text-to-SQL Applications

Agentic RAG simplifies text-to-SQL by modularizing tasks into tools like query transformation, hybrid search, and re-ranking, ensuring accuracy and scalability.

February 18, 2025

by Arjun Bali

· 10,642 Views

Implement Amazon S3 Cross-Region Replication With Terraform

Learn how to configure Amazon S3 Cross-Region Replication using Terraform to automate and streamline data redundancy, compliance, and disaster recovery setups.

February 18, 2025

by Srinivas Chippagiri

CORE

· 19,379 Views · 1 Like

Container Checkpointing in Kubernetes With a Custom API

This article discusses using a Kubernetes sidecar for container checkpointing: build, push, deploy to K8s, and trigger checkpoints via API for state management.

February 18, 2025

by VARUNREDDY DEVIREDDY

· 6,035 Views · 1 Like

The Delegated Chain of Thought Architecture

The D-CoT architecture decouples reasoning from execution in LLM by centralizing reasoning in a "modulith" and delegating execution tasks to specialized modules.

February 18, 2025

by Pier-Jean MALANDRINO

CORE

· 4,801 Views · 4 Likes

Generate Unit Tests With AI Using Ollama and Spring Boot

Run Ollama LLM locally with Spring Boot to generate unit tests for Java. Ensure data privacy, easy setup, and seamless integration with Spring AI.

February 18, 2025

by Amol Gote

CORE

· 8,567 Views · 4 Likes

Multimodal RAG With Colpali, Milvus, and VLMs

Build a multimodal RAG app with ColPali, Milvus, and a visual language model to enable Q&A on PDFs using text and visual data indexed for efficient search.

February 18, 2025

by Saumitra Srivastav

· 2,044 Views · 3 Likes

Search: From Basic Document Retrieval to Answer Generation

Exploring the evolution of document retrieval systems from traditional text-matching and frequency-based methods to advanced ingestion and retrieval strategies.

February 18, 2025

by Meghana Puvvadi

· 2,994 Views · 1 Like

The Slides of Hands-On Agile 2025

The virtual Hands-on Agile 2025 conference held last month discussed embracing the shift to context-based agility, from leadership to strategy to AI.

February 17, 2025

by Stefan Wolpers

CORE

· 5,882 Views · 1 Like

Integrating Apex With Lightning Web Components

Integrating your LWC with Apex to enable seamless communication between the frontend and backend, to provide robust data handling and processing.

February 17, 2025

by Jaseem Pookandy

CORE

· 4,588 Views · 2 Likes

Scaling ML Models Efficiently With Shared Neural Networks

A shared encoder architecture to decouple customer-specific fine-tuned models from the shared encoder to deploy at scale.

February 17, 2025

by Meghana Puvvadi

· 3,257 Views · 7 Likes

Creating a Web Project: Key Steps to Identify Issues

Learn how to identify web project issues through performance analysis, effective debugging, and product metrics tracking.

February 17, 2025

by Filipp Shcherbanich

CORE

· 6,085 Views · 4 Likes

Have LLMs Solved the Search Problem?

LLMs, while strong in content generation, need techniques like semantic chunking and vector embeddings to address the search problem in complex data environments.

February 17, 2025

by Avi Dubey

· 3,404 Views · 1 Like

The Latest Data Engineering Topics