Data Engineering Resources

Java’s Next Act: Native Speed for a Cloud-Native World

The Graal Stack reinvents Java for the cloud era, combining GraalVM, Micronaut and GraalOS to deliver ultra-fast, lightweight, and serverless-ready applications.

April 30, 2025

by Graziano Casto

CORE

· 6,641 Views · 7 Likes

Building Scalable and Resilient Data Pipelines With Apache Airflow

Learn to build scalable, fault-tolerant, and observable data pipelines with Apache Airflow, focusing on real-time insights and custom reporting for enterprise SaaS.

April 30, 2025

by Ramya K R Vuyyuru

· 2,956 Views · 1 Like

The Modern Data Stack Is Overrated — Here’s What Works

The modern data stack is overrated. What works? Fewer tools, clear ownership, and systems your team actually understands.

April 29, 2025

by Rahul .

· 3,073 Views · 1 Like

Scaling InfluxDB for High-Volume Reporting With Continuous Queries (CQs)

In this article, we improved InfluxDB query performance by using Continuous Queries to pre-aggregate high-volume Kafka data for faster, efficient reporting.

April 29, 2025

by Venkata Ashok Kumar Boyina

· 2,445 Views · 3 Likes

On-Call That Doesn’t Suck: A Guide for Data Engineers

Data pipelines don’t fail silently; they make a lot of noise. The question is, are you listening to the signal or drowning in noise?

April 29, 2025

by Tulika Bhatt

· 2,345 Views · 1 Like

Unlocking AI Coding Assistants Part 2: Generating Code

Examine the effectiveness of AI coding assistants, highlight their potential and limitations in generating javadoc, names, and performing small coding tasks.

April 29, 2025

by Gunter Rotsaert

CORE

· 2,135 Views · 2 Likes

Build an MCP Server Using Go to Connect AI Agents With Databases

Learn to build an MCP server using Go to connect AI agents with Azure Cosmos DB, enabling seamless database interactions with Go SDK and mcp-go tools.

April 29, 2025

by Abhishek Gupta

CORE

· 3,030 Views · 2 Likes

The Transformative Power of Artificial Intelligence in Cloud Security

Explore the evolving role of AI in cloud security, the benefits it brings, and the challenges it helps organizations overcome.

April 29, 2025

by Shaik Abdul Kareem

· 12,941 Views · 2 Likes

The Role of Artificial Intelligence in Climate Change Mitigation

AI’s role in tackling climate change is set to grow significantly, driving innovative solutions through deeper analysis and machine learning.

April 29, 2025

by Dennis Helfer

· 1,296 Views · 1 Like

How To Replicate Oracle Data to BigQuery With Google Cloud Datastream

Set up Oracle 19c to BigQuery replication using Google Cloud Datastream, covering prerequisites, networking, CDC setup, and job validation.

April 29, 2025

by Karteek Kotamsetty

· 17,591 Views · 3 Likes

Filtering Messages With Azure Content Safety and Spring AI

Learn how to use Azure Content Safety with Spring AI to detect harmful input and prevent unsafe messages from reaching your chat model.

April 28, 2025

by Tamas Kiss

· 3,018 Views · 1 Like

Building Data Pipelines With Jira API

Automate Jira workflows via API with Python: tickets on pipeline failures, JQL reports, and data sync. Start with failed transfers and expand to dashboards and testing.

April 28, 2025

by Saeed Ashif Ahmed

· 3,312 Views · 1 Like

Doris: Unifying SQL Dialects for a Seamless Data Query Ecosystem

Apache Doris breaks this barrier with its powerful SQL dialect compatibility and builds a unified data query ecosystem for users.

April 28, 2025

by Darren Xu

· 2,452 Views

Contextual AI Integration for Agile Product Teams

This article introduces Contextual AI Integration for agile product teams. Stop treating AI as a team member to “onboard;“ AI is a tool that requires context.

April 28, 2025

by Stefan Wolpers

CORE

· 3,756 Views · 2 Likes

Building a Simple Todo App With Model Context Protocol (MCP)

MCP is an open standard that connects AI models, apps, and data sources, enabling secure and easy integrations for AI-driven tools and workflows.

April 28, 2025

by Suleiman Dibirov

CORE

· 2,038 Views · 3 Likes

Building Event-Driven Go Applications With Azure Cosmos DB and Azure Functions

Learn how to build serverless Azure Functions with Go, using Cosmos DB triggers and Azure OpenAI for generating embeddings in this step-by-step guide.

April 28, 2025

by Abhishek Gupta

CORE

· 2,528 Views

Thermometer Continuation in Scala

Implement thermometer continuations in Scala using exceptions and state to capture, replay, and resume control flow with minimal changes to the language.

April 25, 2025

by Michael Wang

· 4,062 Views · 1 Like

SQL Server Index Optimization Strategies: Best Practices with Ola Hallengren’s Scripts

This guide covers the effective implementation of Ola Hallengren's SQL Server Maintenance Solution for index optimization, especially in Availability Group environments.

April 25, 2025

by arvind toorpu

CORE

· 6,111 Views · 2 Likes

Clean Up Event Data in Ansible Event-Driven Automation

Clean and normalize event data in Ansible Event-Driven Automation (EDA) with the ansible.eda.dashes_to_underscores filter for smoother, more reliable automation.

April 25, 2025

by Binoj Melath Nalinakshan Nair

CORE

· 5,782 Views · 5 Likes

How to Build the Right Infrastructure for AI in Your Private Cloud

Build scalable infrastructure with GPUs for AI workloads, manage data pipelines efficiently, and ensure security and compliance.

April 25, 2025

by Siva Kiran Nandipati

· 5,116 Views · 1 Like

The Latest Data Engineering Topics