Data Engineering Resources

Achieving Security and Trust in a Data Fabric: The Role of Zero Trust Architecture

Explore how zero-trust architecture (ZTA) can provide a solid foundation for achieving security and trust in a data fabric.

January 6, 2025

by Julian Durand

· 3,893 Views · 2 Likes

Efficiently Processing Billions of Rows Daily With Presto

In this article, we will delve into strategies for efficiently storing and processing large datasets using Presto.

January 6, 2025

by Ajay Krishnan Prabhakaran

· 3,583 Views · 2 Likes

Why Successful Companies Don't Have DBAs

Consider the possibility that DBAs' current role may be problematic and that we need to rethink how they operate and integrate within our organizations.

January 6, 2025

by Adam Furmanek

CORE

· 3,775 Views · 6 Likes

Setting Up Local Kafka Container for Spring Boot Application

Set up Kafka container for Spring Boot application, which covers container configuration, Docker Desktop, and Spring Boot integration.

January 6, 2025

by Amol Gote

CORE

· 4,206 Views · 3 Likes

Revolutionize Stream Processing With Data Fabric

An open-source distributed event-streaming platform like Apache Kafka supports data fabric by handling real-time data streaming across various systems.

January 6, 2025

by Gautam Goswami

CORE

· 2,733 Views · 2 Likes

Graph Database Pruning for Knowledge Representation in LLMs

Pruning graph databases makes LLMs faster and more efficient by removing unnecessary info and improving recommendations while saving power and resources.

January 6, 2025

by Srinivas Murri

· 2,609 Views · 2 Likes

Event-Driven AI: Building a Research Assistant With Kafka and Flink

Learn about the development of an AI-powered research assistant created to help prepare for podcast interviews.

January 6, 2025

by Sean Falconer

· 2,437 Views · 3 Likes

Unsupervised Learning Methods for Analyzing Encrypted Network Traffic

Unsupervised learning analyzes encrypted traffic patterns, enhancing security without decryption, using clustering and anomaly detection techniques.

January 3, 2025

by Anurag Agrawal

· 3,241 Views

Demystifying Big O Notation

Big O Notation is probably going to be the first thing you hear about when learning about data structures and algorithms. Let's make it easy to understand.

January 3, 2025

by Jesse Price

· 3,301 Views · 5 Likes

How to Resolve SQL Server 'Database cannot be Opened' Issue Due to MDF Corruption?

Resolve the "Database cannot be opened" issue in SQL Server caused by MDF file corruption with methods like backup restoration, DBCC CHECKDB, or repair tools.

January 3, 2025

by Priyanka Chauhan

· 2,723 Views · 1 Like

Optimizing Performance in Azure Cosmos DB: Best Practices and Tips

Optimize performance, minimize costs, and ensure scalability in Azure Cosmos DB with practices like selecting the right partition key and tuning queries.

January 2, 2025

by Muhammad Imran Ansari

· 4,999 Views

Avoiding If-Else: Advanced Approaches and Alternatives

Skip if-else statements by using design patterns, polymorphism, and functional strategies for cleaner, more adaptable, and significantly more testable code architectures.

January 2, 2025

by Taras Ivashchuk

· 8,467 Views · 12 Likes

Software Development Trends to Follow in 2025

In this blog, I will discuss key software development trends for 2025, from AI-powered tools to ethical AI, low-code platforms, and cloud-native advancements.

January 2, 2025

by Fawad Malik

· 6,231 Views · 6 Likes

Stop Being Afraid of Databases

Ensuring database reliability can be difficult. Our goal is to speed up development and minimize rollbacks. Achieving efficient processes requires database observability.

January 2, 2025

by Adam Furmanek

CORE

· 4,079 Views · 2 Likes

Kubernetes Deployments With DMZ Clusters: An Essential Guide

A DMZ cluster in Kubernetes secures public services from internal workloads, enhancing scalability, reducing attack surface, and ensuring controlled access.

January 2, 2025

by Sai Sandeep Ogety

CORE

· 5,290 Views · 13 Likes

Incremental Jobs and Data Quality Are On a Collision Course

Big data isn’t dead; it’s just going incremental. But bad things happen when uncontrolled changes collide with incremental jobs. Reacting to changes is a losing strategy.

January 1, 2025

by Jack Vanlightly

· 4,643 Views · 1 Like

Logical Reasoning in Network Problems

Online issues can be highly complex, requiring the capture of key information for a clear understanding. Through logical reasoning, the root cause was pinpointed.

January 1, 2025

by Bin Wang

· 5,976 Views · 3 Likes

Boosting Performance and Efficiency: Enhancing React Applications With GraphQL Over REST APIs

This article guides you through setting up a GraphQL server, defining schemas, and integrating with React, highlighting benefits and potential challenges.

January 1, 2025

by Shreyam Dutta Gupta

· 5,204 Views · 6 Likes

Driving RAG-Based AI Infrastructure

When paired with AI agents for workflow orchestration, RAG-based AI infrastructure excels in dynamic decision-making, analytics, and automation.

January 1, 2025

by Apurva Kumar

· 2,939 Views · 2 Likes

Data Lake vs. Data Warehouse vs. Data Lakehouse

The three data storage options and their pros and cons: the legacy data warehouse, the more recent data lake, and contemporary data lakehouse architectures.

December 31, 2024

by Noa Shavit

· 4,667 Views · 4 Likes

The Latest Data Engineering Topics