Data Engineering Resources

Agentic Workflows for Unlocking User Engagement Insights

Learn how to generate actionable insights by having agentic workflows deployed on your user engagement data with the help of CrewAI.

February 19, 2025

by Pavan Vemuri

CORE

· 4,408 Views · 10 Likes

Streamline Microservices Development With Dapr and Amazon EKS

Learn how the combination of Dapr and Amazon EKS accelerates development, enhances applications' resilience, and improves scalability.

February 19, 2025

by Jatinder Singh

· 7,327 Views

The Recursive Prerequisite [Comic]

Interviewing for a new developer job? You may want to brush up on your knowledge of Quicksort (and recruiting).

February 19, 2025

by Daniel Stori

CORE

· 4,538 Views · 4 Likes

Building Intelligent Microservices With Go and AWS AI Services

The development of intelligent applications has seen exponential growth since the convergence of Microservices architecture and cloud-based AI services.

February 18, 2025

by Sairamakrishna BuchiReddy Karri

· 5,206 Views · 2 Likes

Data Privacy and Governance in Real-Time Data Streaming

Real-time data streaming delivers fast insights but raises privacy and compliance risks. Use encryption, tokenization, and policy enforcement for secure streaming.

February 18, 2025

by Murugan Lakshmanan

· 3,900 Views · 1 Like

Dive Into Tokenization, Attention, and Key-Value Caching

This article covers how key-value caching works and how it helps optimize large language models. It includes a text generation process to make it easy to understand.

February 18, 2025

by Kailash Thiyagarajan

· 5,732 Views · 1 Like

Creating an Agentic RAG for Text-to-SQL Applications

Agentic RAG simplifies text-to-SQL by modularizing tasks into tools like query transformation, hybrid search, and re-ranking, ensuring accuracy and scalability.

February 18, 2025

by Arjun Bali

· 10,881 Views

Implement Amazon S3 Cross-Region Replication With Terraform

Learn how to configure Amazon S3 Cross-Region Replication using Terraform to automate and streamline data redundancy, compliance, and disaster recovery setups.

February 18, 2025

by Srinivas Chippagiri

CORE

· 19,545 Views · 1 Like

Container Checkpointing in Kubernetes With a Custom API

This article discusses using a Kubernetes sidecar for container checkpointing: build, push, deploy to K8s, and trigger checkpoints via API for state management.

February 18, 2025

by VARUNREDDY DEVIREDDY

· 6,258 Views · 1 Like

The Delegated Chain of Thought Architecture

The D-CoT architecture decouples reasoning from execution in LLM by centralizing reasoning in a "modulith" and delegating execution tasks to specialized modules.

February 18, 2025

by Pier-Jean MALANDRINO

CORE

· 4,931 Views · 4 Likes

Generate Unit Tests With AI Using Ollama and Spring Boot

Run Ollama LLM locally with Spring Boot to generate unit tests for Java. Ensure data privacy, easy setup, and seamless integration with Spring AI.

February 18, 2025

by Amol Gote

CORE

· 8,928 Views · 4 Likes

Multimodal RAG With Colpali, Milvus, and VLMs

Build a multimodal RAG app with ColPali, Milvus, and a visual language model to enable Q&A on PDFs using text and visual data indexed for efficient search.

February 18, 2025

by Saumitra Srivastav

· 2,089 Views · 3 Likes

Search: From Basic Document Retrieval to Answer Generation

Exploring the evolution of document retrieval systems from traditional text-matching and frequency-based methods to advanced ingestion and retrieval strategies.

February 18, 2025

by Meghana Puvvadi

· 3,114 Views · 1 Like

The Slides of Hands-On Agile 2025

The virtual Hands-on Agile 2025 conference held last month discussed embracing the shift to context-based agility, from leadership to strategy to AI.

February 17, 2025

by Stefan Wolpers

CORE

· 5,966 Views · 1 Like

Integrating Apex With Lightning Web Components

Integrating your LWC with Apex to enable seamless communication between the frontend and backend, to provide robust data handling and processing.

February 17, 2025

by Jaseem Pookandy

CORE

· 4,720 Views · 2 Likes

Scaling ML Models Efficiently With Shared Neural Networks

A shared encoder architecture to decouple customer-specific fine-tuned models from the shared encoder to deploy at scale.

February 17, 2025

by Meghana Puvvadi

· 3,414 Views · 7 Likes

Creating a Web Project: Key Steps to Identify Issues

Learn how to identify web project issues through performance analysis, effective debugging, and product metrics tracking.

February 17, 2025

by Filipp Shcherbanich

CORE

· 6,213 Views · 4 Likes

Have LLMs Solved the Search Problem?

LLMs, while strong in content generation, need techniques like semantic chunking and vector embeddings to address the search problem in complex data environments.

February 17, 2025

by Avi Dubey

· 3,506 Views · 1 Like

Build a Data Analytics Platform With Flask, SQL, and Redis

Building a Flask-based web app that has dynamic querying for population thresholds, Redis caching for faster queries, and secure, scalable architecture.

February 17, 2025

by Sushma Kukkadapu

· 5,347 Views · 2 Likes

From Data to Decisions: Visualizing SAP Insights With Python

SAP data insights simplified with Python: A versatile tool for advanced analytics, automation, and managing large datasets.

February 17, 2025

by Prasanna Chandran Melnatami Krishnaram

· 2,752 Views · 5 Likes

The Latest Data Engineering Topics