Data Engineering Resources

I Built an Automatic Proposal Generation LLM and Open-Sourced It on GitHub

Existing large models couldn’t solve my problem, so I built my own — an open-source tool for automating proposal generation efficiently.

January 7, 2025

by William Guo

· 6,453 Views

Pathway to Legacy Application Retirement

This article looks at application retirement from a data perspective, best practices, challenges, and how to manage and leverage data during this process.

January 7, 2025

by Abhik Choudhury

· 3,796 Views · 2 Likes

Usage of GenAI for Personalized Customer Experience in Mobile Apps

Generative AI enhances mobile apps with personalized, engaging user experiences, delighting users through smart data use and continuous improvement.

January 7, 2025

by Yogesh Rathod

· 2,831 Views · 2 Likes

A Deep Dive on Read Your Own Writes Consistency

This article is intended for distributed systems practitioners looking to understand and implement Read Your Own Writes consistency in production environments.

January 7, 2025

by Ganapathy Subramanian Ramachandran

· 7,476 Views · 3 Likes

Automating Twilio Recording Exports for Quality Purposes: Python Implementation Guidelines

Discover how to use Python to download recordings from Twilio and transcribe them for sentimental analysis, quality, and audit purposes.

January 7, 2025

by Sandeep Kakani

· 4,371 Views · 2 Likes

Applying ML and AI for Effective Spamhaus Email Etiquette

Explore how ML/AI can be leveraged for Spamhaus email etiquette and security, highlighting techniques used for spam detection, and upholding responsible email standards.

January 7, 2025

by John Akkarakaran Jose

· 10,332 Views · 1 Like

Data Governance Challenges in the Age of Generative AI

Navigate privacy, security, and compliance challenges for innovation. Effective data governance is now more critical due to recent generative AI developments.

January 7, 2025

by nishchai jayanna manjula

· 7,000 Views · 3 Likes

Testing Is a Cross-Cutting Concern; So Are Databases

It’s essential to test all database changes cohesively throughout the pipeline. Let’s explore how this can be achieved with a modern approach.

January 7, 2025

by Adam Furmanek

CORE

· 4,240 Views · 3 Likes

How to Test DELETE Requests for API Testing With Playwright Java

This tutorial demonstrates how to test DELETE requests using the Playwright Java framework for API testing, using examples of deleting data using an API.

January 7, 2025

by Faisal Khatri

CORE

· 6,275 Views · 2 Likes

The Evolution of Adaptive Frameworks

Adaptive frameworks revolutionize collaboration by providing real-time, personalized updates that address traditional tool limitations.

January 6, 2025

by Manasi Sharma

· 3,921 Views · 2 Likes

Achieving Security and Trust in a Data Fabric: The Role of Zero Trust Architecture

Explore how zero-trust architecture (ZTA) can provide a solid foundation for achieving security and trust in a data fabric.

January 6, 2025

by Julian Durand

· 5,403 Views · 3 Likes

Efficiently Processing Billions of Rows Daily With Presto

In this article, we will delve into strategies for efficiently storing and processing large datasets using Presto.

January 6, 2025

by Ajay Krishnan Prabhakaran

· 5,506 Views · 3 Likes

Why Successful Companies Don't Have DBAs

Consider the possibility that DBAs' current role may be problematic and that we need to rethink how they operate and integrate within our organizations.

January 6, 2025

by Adam Furmanek

CORE

· 4,611 Views · 7 Likes

Setting Up Local Kafka Container for Spring Boot Application

Set up Kafka container for Spring Boot application, which covers container configuration, Docker Desktop, and Spring Boot integration.

January 6, 2025

by Amol Gote

CORE

· 6,612 Views · 4 Likes

Revolutionize Stream Processing With Data Fabric

An open-source distributed event-streaming platform like Apache Kafka supports data fabric by handling real-time data streaming across various systems.

January 6, 2025

by Gautam Goswami

CORE

· 3,857 Views · 3 Likes

Graph Database Pruning for Knowledge Representation in LLMs

Pruning graph databases makes LLMs faster and more efficient by removing unnecessary info and improving recommendations while saving power and resources.

January 6, 2025

by Srinivas M

· 4,394 Views · 7 Likes

Event-Driven AI: Building a Research Assistant With Kafka and Flink

Learn about the development of an AI-powered research assistant created to help prepare for podcast interviews.

January 6, 2025

by Sean Falconer

· 3,540 Views · 3 Likes

Unsupervised Learning Methods for Analyzing Encrypted Network Traffic

Unsupervised learning analyzes encrypted traffic patterns, enhancing security without decryption, using clustering and anomaly detection techniques.

January 3, 2025

by Anurag Agrawal

· 5,739 Views

Demystifying Big O Notation

Big O Notation is probably going to be the first thing you hear about when learning about data structures and algorithms. Let's make it easy to understand.

January 3, 2025

by Jesse Price

· 4,301 Views · 6 Likes

How to Resolve SQL Server 'Database cannot be Opened' Issue Due to MDF Corruption?

Resolve the "Database cannot be opened" issue in SQL Server caused by MDF file corruption with methods like backup restoration, DBCC CHECKDB, or repair tools.

January 3, 2025

by Priyanka Chauhan

· 5,213 Views · 1 Like

The Latest Data Engineering Topics