Data Engineering Resources

CRDTs Explained: How Conflict-Free Replicated Data Types Work

Explore Conflict-free Replicated Data Types. Data structure designed to ensure that data on different replicas will eventually converge into a consistent state.

April 24, 2025

by Bartłomiej Żyliński

CORE

· 6,577 Views · 2 Likes

Auto-Instrumentation in Azure Application Insights With AKS

Demo of auto-instrumentation with App Insights on AKS: This article provides a demo of how to enable monitoring on applications without requiring code changes.

April 24, 2025

by Aritra Ghosh

· 4,588 Views

Reinforcement Learning for AI Agent Development: Implementing Multi-Agent Systems

Let's learn how to implement a simple AI agent with reinforcement learning using a multi-agent system in Python, and have a little fun along the way.

April 24, 2025

by Srinivas Chippagiri

CORE

· 18,987 Views · 2 Likes

Optimizing AI Model: A Guide to Improving Performance (3 of 3)

This guide covers data preprocessing, algorithmic improvements, hyperparameter tuning, hardware acceleration, and deployment strategies to improve performance.

April 24, 2025

by Srinivas Chippagiri

CORE

· 17,691 Views · 2 Likes

Key Considerations in Cross-Model Migration

Navigating the challenges of AI model migration, this guide explores differences in tokenization, context windows, formatting, and response structure across LLMs.

April 23, 2025

by Lavanya Gupta

· 3,788 Views · 1 Like

Apache Doris vs Elasticsearch: An In-Depth Comparative Analysis

Apache Doris excels in complex analytics with SQL support and high performance, while Elasticsearch is ideal for full-text search and real-time retrieval.

April 23, 2025

by Michael Hayden

· 5,088 Views · 2 Likes

Failure Handling Mechanisms in Microservices and Their Importance

In this article, we will explore different failure-handling mechanisms in microservices and understand their importance in building resilient applications.

April 23, 2025

by Arunkumar Kallyodan

· 9,475 Views · 12 Likes

AI Model Evaluation: Metrics, Visualization and Performance (2 of 3)

Evaluate AI models using key metrics and visualization tools to ensure fairness, reliability and scalability in real-world applications.

April 23, 2025

by Srinivas Chippagiri

CORE

· 19,175 Views · 3 Likes

The Role of AI in Enhancing DevOps Processes

AI’s your DevOps wingman—handles the dull crap, sniffs out issues early, and keeps things humming. Early alerts, slick CI/CD testing, and self-fixing systems, all in one.

April 23, 2025

by Sujai Krishna Vasudavan

· 4,605 Views · 1 Like

How to Build Local LLM RAG Apps With Ollama, DeepSeek-R1, and SingleStore

Learn how to use DeepSeek-R1 with SingleStore to analyze PDFs, store embeddings, and discover blockchain investment opportunities in FinTech with LangChain.

April 23, 2025

by Akmal Chaudhri

CORE

· 3,536 Views · 2 Likes

A Modern Stack for Building Scalable Systems

Dive into modern stack recommendations for building robust and scalable systems. This stack is agnostic and can be integrated into all programming languages.

April 23, 2025

by Bartłomiej Żyliński

CORE

· 9,000 Views · 2 Likes

Build Your First AI Model in Python: A Beginner's Guide (1 of 3)

Embark on your AI journey with this step-by-step tutorial, designed to guide beginners through building a basic AI model in Python.

April 22, 2025

by Srinivas Chippagiri

CORE

· 21,842 Views · 3 Likes

From Concept to Cloud: Building With Cursor and the Heroku MCP Server

In this article, I used Cursor and Heroku’s MCP Server to build and deploy a SvelteKit app entirely through prompts—no CLI, just AI.

April 22, 2025

by Alvin Lee

CORE

· 5,485 Views · 1 Like

How to Restore a Transaction Log Backup in SQL Server

Learn to restore SQL Server transaction log backups step by step, including prerequisites, backup types, troubleshooting errors, and best practices.

April 22, 2025

by Nisarg Upadhyay

· 5,482 Views

Unlocking AI Coding Assistants Part 1: Real-World Use Cases

Dive into some AI coding assistant use cases and their effectiveness, highlighting their capabilities and limitations.

April 21, 2025

by Gunter Rotsaert

CORE

· 3,467 Views · 1 Like

Stateless vs Stateful Stream Processing With Kafka Streams and Apache Flink

Concepts and benefits of stateless and stateful stream processing with Kafka Streams and Apache Flink vs. databases and data lakes.

April 21, 2025

by Kai Wähner

CORE

· 7,245 Views · 4 Likes

Platform Engineering for Cloud Teams

Platform engineering empowers cloud teams by streamlining infrastructure, automating workflows, and enhancing developer experience to drive efficiency and innovation.

April 21, 2025

by Josephine Eskaline Joyce

CORE

· 7,317 Views · 10 Likes

The Rise of Shadow AI: When Innovation Outpaces Governance

Employees adopt AI tools faster than governance can react. Shadow AI isn’t a threat—it’s a signal. Rather than ban it, organizations should guide it with clear policies.

April 21, 2025

by Frederic Jacquet

CORE

· 3,225 Views · 3 Likes

Simplifying Vector Embeddings With Go, Cosmos DB, and OpenAI

Learn how to build a Go web app to generate, store, and query vector embeddings using Azure Cosmos DB and OpenAI, with step-by-step guidance.

April 21, 2025

by Abhishek Gupta

CORE

· 3,942 Views · 2 Likes

AI Interview Analysis

This article discusses how to use generative artificial intelligence to analyze interviews from teammates, stakeholders, and management for better insights.

April 21, 2025

by Stefan Wolpers

CORE

· 3,476 Views · 3 Likes

The Latest Data Engineering Topics