Data Engineering Resources

AWS CloudTrail Insights can detect unusual API activity in your AWS environment. This feature helps spot anomalies and fix potential issues more easily.

January 20, 2025

by Sajith Narayanan

· 11,144 Views · 1 Like

Seamless Transition from Elasticsearch to OpenSearch

A step-by-step guide for migrating from Elasticsearch to OpenSearch, ensuring compatibility, performance, and cost-efficiency.

January 20, 2025

by Nilesh Jain

· 6,911 Views · 3 Likes

Real-Time Data Streaming With AI

Real-time data streaming combined with AI transforms traditional analytics by enabling instant insights, scalability, and improved decision-making.

January 20, 2025

by Suri (thammuio)

CORE

· 16,934 Views · 3 Likes

Create a Custom Logger to Log Response Details With Playwright Java

This tutorial teaches how to create a custom logger for login response details using the Playwright Java framework for API testing.

January 20, 2025

by Faisal Khatri

CORE

· 8,062 Views · 5 Likes

How to Edit a PowerPoint PPTX Document in Java

Learn how PowerPoint PPTX files are structured and discover popular open-source and web-API solutions for programmatically editing PPTX content in Java.

January 20, 2025

by Brian O'Neill

CORE

· 6,955 Views · 3 Likes

Evolution of Recommendation Systems: From Legacy Rules Engines to Machine Learning

Legacy rules engines offer predictable automation but lack scalability and personalization; ML revolutionized this by enabling adaptive, data-driven decisions.

January 20, 2025

by Rambabu Bandam

· 9,212 Views · 2 Likes

A Guide to Deploying AI for Real-Time Content Moderation

A step-by-step guide to deploying an AI-powered real-time content moderation system, covering data collection, processing, models, and human review.

January 20, 2025

by Hack ER

· 4,067 Views

Building a Reactive Event-Driven App With Dead Letter Queue

Learn how to build fault-tolerant, reactive event-driven applications using Spring WebFlux, Apache Kafka, and Dead Letter Queue to handle data loss efficiently.

January 20, 2025

by Sulakshana Singh

· 4,945 Views · 4 Likes

Optimizing Prometheus Queries With PromQL

Count worker nodes and track resource changes in Prometheus using PromQL. Explore queries, best practices, and dynamic thresholds for Kubernetes monitoring.

January 20, 2025

by Ganesh Bhat

· 8,757 Views · 4 Likes

Troubleshooting Connection Issues When Connecting to MySQL Server

Resolve MySQL connection issues with step-by-step fixes for errors like access denied, host not allowed, and authentication protocol mismatches.

January 20, 2025

by Shareef Sha

· 5,705 Views · 3 Likes

Chain-of-Thought Prompting: A Comprehensive Analysis of Reasoning Techniques in Large Language Models

Chain-of-thought (CoT) prompting enables LLMs to improve their reasoning capabilities. This paper explores various CoT techniques and their practical limitations.

January 20, 2025

by Pier-Jean MALANDRINO

CORE

· 6,005 Views · 3 Likes

Creating Artificial Doubt Significantly Improves AI Math Accuracy

LLMs are better at math with a "verified reasoning trajectory" — an opportunity to review their steps and determine if the math they're doing makes sense.

January 17, 2025

by mike labs

· 3,132 Views

Dark Data: Recovering the Lost Opportunities

Dark data is the vast amounts of unstructured information collected by organizations that often go unused. It includes emails, customer interactions, sensor data, etc.

January 17, 2025

by Vijay Singh Khatri

CORE

· 3,611 Views

Business Logic Database Agent

A natural language agent to create database business logic using declarative rules: an admin web app, API, and database in 1 minute. Download to customize in your IDE.

January 17, 2025

by Val Huber

CORE

· 3,566 Views · 4 Likes

Talk to Your Project: An LLM Experiment You Can Join and Build On

Find out the result of my experiment on integrating LLM into a console application and the insights I gained from the experience.

January 17, 2025

by Filipp Shcherbanich

CORE

· 3,698 Views · 2 Likes

Schema Changes Are a Blind Spot

Schema changes and migrations can quickly spiral into chaos, leading to significant challenges. Let's see how to overcome these challenges.

January 17, 2025

by Adam Furmanek

CORE

· 3,233 Views · 4 Likes

ArangoDB: Achieving Success With a Multivalue Database

ArangoDB's multimodel capabilities simplify handling key-value, document, and graph data in one database. Jakarta NoSQL enables seamless integration.

January 16, 2025

by Otavio Santana

CORE

· 3,999 Views · 1 Like

Understanding Leaderless Replication for Distributed Data

Learn about leaderless replication: its trade-offs, direct writes vs. coordination-based approaches, failure handling, and commercial databases in distributed systems.

January 16, 2025

by Stelios Manioudakis

CORE

· 9,686 Views · 4 Likes

Feature Flags in .NET 8 and Azure

This article describes the importance of feature flags and how they change the way we develop applications while reducing the risk of regressions.

January 16, 2025

by Naga Santhosh Reddy Vootukuri

CORE

· 5,410 Views · 3 Likes

You Need to Validate Your Databases

Without proper management, the risk of misconfigured databases increases — just as Heroku experienced. Learn how to steer clear of similar mistakes.

January 16, 2025

by Adam Furmanek

CORE

· 5,007 Views · 6 Likes

The Latest Data Engineering Topics