Data Engineering Resources

Unlocking AI Coding Assistants: Generate Unit Tests

This blog post instructs on creating qualitative unit tests for a Spring Boot application using an AI coding assistant and its capabilities and limitations.

May 14, 2025

by Gunter Rotsaert

CORE

· 4,154 Views · 2 Likes

Beyond Code Coverage: A Risk-Driven Revolution in Software Testing With Machine Learning

Machine learning-driven, risk-based testing targets critical risks, automates test selection, and improves software reliability.

May 14, 2025

by Gopinath Kathiresan

· 3,988 Views · 2 Likes

A Simple, Convenience Package for the Azure Cosmos DB Go SDK

Learn about cosmosdb-go-sdk-helper: Simplify Azure Cosmos DB operations with Go. Features auth, queries, error handling, metrics, and Azure Functions support.

May 14, 2025

by Abhishek Gupta

CORE

· 3,750 Views · 1 Like

Intro to RAG: Foundations of Retrieval Augmented Generation, Part 1

Retrieval-augmented generation (RAG) retrieves relevant information from external sources to improve the accuracy and reliability of responses, making it a powerful tool.

May 14, 2025

by Jennifer Reif

CORE

· 3,452 Views · 3 Likes

Performing and Managing Incremental Backups Using pg_basebackup in PostgreSQL 17

PostgreSQL 17 adds incremental backups with pg_basebackup and pg_combinebackup, saving time and storage by capturing only changed data since the last backup.

May 14, 2025

by arvind toorpu

CORE

· 3,899 Views · 4 Likes

Ethical AI in Agile

Learn all about ethical AI integration for Agile teams with four key guardrails: Data Privacy, Human Value, Output Validation, and Transparent Attribution.

May 14, 2025

by Stefan Wolpers

CORE

· 2,796 Views · 2 Likes

A Deep Dive Into Firmware Over the Air for IoT Devices

Dive into FOTA, its importance, and best practices to design reliable and efficient FOTA services for IoT devices.

May 13, 2025

by Shweta Agarwal

· 3,646 Views · 1 Like

Agentic AI for Automated Application Security and Vulnerability Management

Explore how agentic AI enables several agents to jointly detect, fix, and verify security vulnerabilities in your codebase.

May 13, 2025

by Vamsi Kavuri

CORE

· 12,891 Views · 1 Like

Ensuring Configuration Consistency Across Global Data Centers

Global data centers need consistent configurations, but engineers misalign across regions. This paper explores the problem, existing solutions, and a proposed approach.

May 13, 2025

by Shubham Jindal

· 2,313 Views · 6 Likes

Fraud Detection Using Artificial Intelligence and Machine Learning

AI/ML is revolutionizing fraud detection with automated, adaptive, real-time anomaly detection, despite challenges like interpretability.

May 13, 2025

by Nikhil Kapoor

· 2,814 Views · 3 Likes

How AI Agents Are Transforming Enterprise Automation Architecture

AI agents enhance enterprise automation through multi-layered architectures, improving efficiency and handling complex tasks across various sectors.

May 13, 2025

by Nishant Bijani

· 3,055 Views

Unmasking Entity-Based Data Masking: Best Practices 2025

Master entity-based data masking with best practices in identifying sensitive data, defining clear policies, preserving relationships, and auditing access.

May 13, 2025

by Yash Mehta

· 3,488 Views · 3 Likes

Scaling DevOps With NGINX Caching: Reducing Latency and Backend Load

Are repeated requests killing your backend? NGINX caching can quietly absorb the load, cut latency, and keep your pipelines flowing — no code changes needed. Here's how!

May 13, 2025

by Jyostna Seelam

· 5,739 Views · 3 Likes

The Role of Retrieval Augmented Generation (RAG) in Development of AI-Infused Enterprise Applications

Explore how RAG enhances enterprise AI apps by improving contextual accuracy, relevance, and response quality across real-world use cases.

May 13, 2025

by Ram Ravishankar

· 2,775 Views

5 Subtle Indicators Your Development Environment Is Under Siege

Threat actors now target SDLC stages. Spot five key indicators of compromise and reinforce dev pipeline security with early detection and response.

May 13, 2025

by Raj Mallempati

· 3,570 Views · 2 Likes

Scalable, Resilient Data Orchestration: The Power of Intelligent Systems

Practical insights for software professionals seeking to design large-scale data orchestration systems that unlock actionable intelligence.

May 12, 2025

by Mahesh Veerabathiran

· 3,560 Views

AI-Based Threat Detection in Cloud Security

Learn how AI enhances cloud security with advanced threat detection methods like supervised learning, LLMs, and self-healing systems, tackling modern challenges.

May 12, 2025

by Tanvir Kaur

· 4,602 Views

Blue Skies Ahead: An AI Case Study on LLM Use for a Graph Theory Related Application

A case study showing how LLMs accelerate graph theory development, reducing coding time from hours to minutes and boosting research productivity.

May 12, 2025

by Gerald Rigdon

· 3,212 Views · 1 Like

Unlocking Data with Language: Real-World Applications of Text-to-SQL Interfaces

Leverage machine learning models to convert natural language queries into accurate and efficient SQL statements with AI-driven text-to-SQL conversion.

May 12, 2025

by Abrar Ahmed Syed

· 4,119 Views · 3 Likes

How Trustworthy Is Big Data?

Big data offers potential, but trust issues arise from poor quality, security, and accuracy. Organizations need strategy, governance, and training to ensure reliability.

May 12, 2025

by Dilip Kumar Rachamalla

· 4,134 Views

The Latest Data Engineering Topics