Data Engineering Resources

Recursive Feature Elimination in Practice

Learn about Recursive Feature Elimination (RFE) to reduce feature count, boost accuracy, prevent overfitting, and build efficient machine learning models.

March 25, 2025

by Srinivas Gurrala

· 1,742 Views

Lakehouse: Starting With Apache Doris + S3 Tables

This is the first article in the “Lakehouse: What’s the Big Deal?” series, where I will periodically discuss Lakehouse. Your comments and discussions are welcome.

March 25, 2025

by Mingyu Chen

· 2,853 Views · 3 Likes

Agentic AI and Generative AI: Revolutionizing Decision Making and Automation

This article examines both agentic and generative AI systems, their relative benefits and drawbacks, their implementation challenges with ethical risks, and more.

March 25, 2025

by Nitish Upadhyay

· 3,082 Views

Make ML Models Work: A Real-World Take on Size and Imbalance

Overcoming NLP hurdles like large models and imbalanced data, the project used TF-IDF, class weighting, and simpler models for accuracy and efficiency.

March 25, 2025

by Gowsiya Syednoor Shek

· 2,161 Views

Mastering Async Context Manager Mocking in Python Tests

Simplify testing complex asynchronous Python code by mastering async context manager mocking with Pytest, ensuring reliable and maintainable test coverage.

March 25, 2025

by Aditya Karnam Gururaj Rao

· 2,723 Views · 2 Likes

Using KRaft Kafka for Development and Kubernetes Deployment

Simplify Kafka with KRaft—ditch ZooKeeper, streamline configs for Docker and Kubernetes, and integrate easily with Spring Boot for development and deployment.

March 25, 2025

by Sven Loesekann

· 4,423 Views · 5 Likes

Video Generation With Java: Leverage Nova and Amazon Bedrock

Learn how to generate videos using Amazon Nova on Amazon Bedrock with Java. This step-by-step guide covers AWS setup and Java code for video creation.

March 25, 2025

by Danil Temnikov

CORE

· 6,010 Views · 4 Likes

How to Get Word Document Form Values Using Java

This article discusses how the DOCX file structure stores form fields and values and suggests a few Java APIs that simplify retrieving DOCX form content.

March 25, 2025

by Brian O'Neill

CORE

· 4,535 Views · 1 Like

Hybrid Backup Strategies: On-Premises vs Cloud for DevOps

In this article, let's take a closer look at what a hybrid deployment model is, its benefits, and tips for transitioning to this backup strategy.

March 24, 2025

by Daria Kulikova

· 2,705 Views · 2 Likes

Text Clustering With Deepseek Reasoning

We will develop and understand a novel approach to text clustering and explain our inference results using the DeepSeek reasoning model.

March 24, 2025

by Kalpan Dharamshi

· 2,153 Views · 2 Likes

Breaking AWS Lambda: Chaos Engineering for Serverless Devs

Our serverless system crashed from traffic surges. With chaos engineering, we purposely broke Lambda, tested failures with AWS FIS, and achieved 99% uptime, 30s MTTR!

March 24, 2025

by Bharath Kumar Reddy Janumpally

· 4,380 Views · 2 Likes

Leverage Amazon BedRock Chat Model With Java and Spring AI

Learn to use Amazon Bedrock to build an app that sends text prompts to a model with Spring AI. This guide covers AWS setup, Spring AI config, and Bedrock integration.

March 24, 2025

by Danil Temnikov

CORE

· 7,585 Views · 5 Likes

Recommender Systems Best Practices: Collaborative Filtering

Recommender systems predict preferences using feedback, tackling sparsity and cold starts with collaborative filtering, matrix factorization, and hybrid models.

March 24, 2025

by Salman Khan

CORE

· 7,506 Views · 2 Likes

Introduce a New API Quickly Using Spring Boot and Gradle

Time to market can make or break any idea or solution. Check out how quickly a RESTful API can be created by leveraging ChatGPT, Spring Boot, Gradle, and Heroku.

March 24, 2025

by John Vester

CORE

· 35,723 Views · 6 Likes

Is Vibe Coding Agile or Merely a Hype?

Learn about vibe coding and how it can enhance agile practices and empower non-technical entrepreneurs, but beware of its issues.

March 24, 2025

by Stefan Wolpers

CORE

· 5,362 Views · 4 Likes

Supercharged LLMs: Combining Retrieval Augmented Generation and AI Agents to Transform Business Operations

In this article, see how RAG and AI agents improve enterprise AI by enhancing accuracy, automation, and decision-making beyond LLM limitations.

March 24, 2025

by Pratik Prakash

CORE

· 2,635 Views · 1 Like

When Doris Meets Iceberg: A Data Engineer's Redemption

Apache Doris and Iceberg are redefining the way data lakes work. It's not just a simple 1+1=2; it brings a qualitative leap!

March 21, 2025

by Zen Hua

· 2,725 Views · 1 Like

Graph API for Entra ID (Azure AD) Object Management

Graph REST API for effective administration of user identities, groups, and devices is essential for organizations of all sizes.

March 21, 2025

by Anant Wairagade

· 5,111 Views · 2 Likes

Data Lake vs. Data Warehouse vs. Data Lakehouse

The pros and cons of the legacy data warehouse, the more recent data lake, and contemporary data lakehouse architectures.

Updated March 21, 2025

by Noa Shavit

· 6,894 Views · 5 Likes

[Part-2] Text to Action: Words to Calendar Events

Turn your words into calendar events effortlessly! This AI-powered assistant understands your text, extracts key details, and schedules events for you.

March 21, 2025

by Vivek Vellaiyappan Surulimuthu

· 3,203 Views · 2 Likes

The Latest Data Engineering Topics