Data Engineering Resources

Contextual AI Integration for Agile Product Teams

This article introduces Contextual AI Integration for agile product teams. Stop treating AI as a team member to “onboard;“ AI is a tool that requires context.

April 28, 2025

by Stefan Wolpers

CORE

· 4,585 Views · 2 Likes

Building a Simple Todo App With Model Context Protocol (MCP)

MCP is an open standard that connects AI models, apps, and data sources, enabling secure and easy integrations for AI-driven tools and workflows.

April 28, 2025

by Suleiman Dibirov

CORE

· 3,888 Views · 3 Likes

Building Event-Driven Go Applications With Azure Cosmos DB and Azure Functions

Learn how to build serverless Azure Functions with Go, using Cosmos DB triggers and Azure OpenAI for generating embeddings in this step-by-step guide.

April 28, 2025

by Abhishek Gupta

CORE

· 3,109 Views

Thermometer Continuation in Scala

Implement thermometer continuations in Scala using exceptions and state to capture, replay, and resume control flow with minimal changes to the language.

April 25, 2025

by Michael Wang

· 4,564 Views · 1 Like

SQL Server Index Optimization Strategies: Best Practices with Ola Hallengren’s Scripts

This guide covers the effective implementation of Ola Hallengren's SQL Server Maintenance Solution for index optimization, especially in Availability Group environments.

April 25, 2025

by arvind toorpu

CORE

· 8,930 Views · 4 Likes

Clean Up Event Data in Ansible Event-Driven Automation

Clean and normalize event data in Ansible Event-Driven Automation (EDA) with the ansible.eda.dashes_to_underscores filter for smoother, more reliable automation.

April 25, 2025

by Binoj Melath Nalinakshan Nair

CORE

· 6,466 Views · 5 Likes

How to Build the Right Infrastructure for AI in Your Private Cloud

Build scalable infrastructure with GPUs for AI workloads, manage data pipelines efficiently, and ensure security and compliance.

April 25, 2025

by Siva Kiran Nandipati

· 6,097 Views · 2 Likes

Power BI Embedded Analytics — Part 1: Introduction and Power BI Authoring Overview

Introduction to embedded analytics with Power BI. Covers the basics, helping you kickstart your journey into leveraging embedded analytics for informed decision-making.

April 24, 2025

by Robin Rizvi

CORE

· 3,707 Views · 2 Likes

Scaling in Practice: Caching and Rate-Limiting With Redis and Next.js

Redis powers both caching (to speed up API responses) and rate limiting (to prevent faucet abuse), offering performance improvements and protecting against abuse.

April 24, 2025

by Ernest Nnamdi

· 6,301 Views · 2 Likes

CRDTs Explained: How Conflict-Free Replicated Data Types Work

Explore Conflict-free Replicated Data Types. Data structure designed to ensure that data on different replicas will eventually converge into a consistent state.

April 24, 2025

by Bartłomiej Żyliński

CORE

· 6,213 Views · 2 Likes

Auto-Instrumentation in Azure Application Insights With AKS

Demo of auto-instrumentation with App Insights on AKS: This article provides a demo of how to enable monitoring on applications without requiring code changes.

April 24, 2025

by Aritra Ghosh

· 4,255 Views

Reinforcement Learning for AI Agent Development: Implementing Multi-Agent Systems

Let's learn how to implement a simple AI agent with reinforcement learning using a multi-agent system in Python, and have a little fun along the way.

April 24, 2025

by Srinivas Chippagiri

CORE

· 18,169 Views · 2 Likes

Optimizing AI Model: A Guide to Improving Performance (3 of 3)

This guide covers data preprocessing, algorithmic improvements, hyperparameter tuning, hardware acceleration, and deployment strategies to improve performance.

April 24, 2025

by Srinivas Chippagiri

CORE

· 17,268 Views · 2 Likes

Key Considerations in Cross-Model Migration

Navigating the challenges of AI model migration, this guide explores differences in tokenization, context windows, formatting, and response structure across LLMs.

April 23, 2025

by Lavanya Gupta

· 3,644 Views · 1 Like

Apache Doris vs Elasticsearch: An In-Depth Comparative Analysis

Apache Doris excels in complex analytics with SQL support and high performance, while Elasticsearch is ideal for full-text search and real-time retrieval.

April 23, 2025

by Michael Hayden

· 4,872 Views · 2 Likes

Failure Handling Mechanisms in Microservices and Their Importance

In this article, we will explore different failure-handling mechanisms in microservices and understand their importance in building resilient applications.

April 23, 2025

by Arunkumar Kallyodan

· 8,965 Views · 12 Likes

AI Model Evaluation: Metrics, Visualization and Performance (2 of 3)

Evaluate AI models using key metrics and visualization tools to ensure fairness, reliability and scalability in real-world applications.

April 23, 2025

by Srinivas Chippagiri

CORE

· 18,884 Views · 3 Likes

The Role of AI in Enhancing DevOps Processes

AI’s your DevOps wingman—handles the dull crap, sniffs out issues early, and keeps things humming. Early alerts, slick CI/CD testing, and self-fixing systems, all in one.

April 23, 2025

by Sujai Krishna Vasudavan

· 4,326 Views · 1 Like

How to Build Local LLM RAG Apps With Ollama, DeepSeek-R1, and SingleStore

Learn how to use DeepSeek-R1 with SingleStore to analyze PDFs, store embeddings, and discover blockchain investment opportunities in FinTech with LangChain.

April 23, 2025

by Akmal Chaudhri

CORE

· 3,394 Views · 2 Likes

A Modern Stack for Building Scalable Systems

Dive into modern stack recommendations for building robust and scalable systems. This stack is agnostic and can be integrated into all programming languages.

April 23, 2025

by Bartłomiej Żyliński

CORE

· 8,869 Views · 2 Likes

The Latest Data Engineering Topics