Data Engineering Resources

Schema changes and migrations can quickly spiral into chaos, leading to significant challenges. Let's see how to overcome these challenges.

January 17, 2025

by Adam Furmanek

CORE

· 3,186 Views · 4 Likes

ArangoDB: Achieving Success With a Multivalue Database

ArangoDB's multimodel capabilities simplify handling key-value, document, and graph data in one database. Jakarta NoSQL enables seamless integration.

January 16, 2025

by Otavio Santana

CORE

· 3,903 Views · 1 Like

Understanding Leaderless Replication for Distributed Data

Learn about leaderless replication: its trade-offs, direct writes vs. coordination-based approaches, failure handling, and commercial databases in distributed systems.

January 16, 2025

by Stelios Manioudakis

CORE

· 9,503 Views · 4 Likes

Feature Flags in .NET 8 and Azure

This article describes the importance of feature flags and how they change the way we develop applications while reducing the risk of regressions.

January 16, 2025

by Naga Santhosh Reddy Vootukuri

CORE

· 5,308 Views · 3 Likes

You Need to Validate Your Databases

Without proper management, the risk of misconfigured databases increases — just as Heroku experienced. Learn how to steer clear of similar mistakes.

January 16, 2025

by Adam Furmanek

CORE

· 4,947 Views · 6 Likes

In this tutorial, we will take an in-depth look at Google Analytics Hub, a tool to securely share and access data, simplifying collaboration and analysis

January 16, 2025

by Karteek Kotamsetty

· 13,401 Views · 3 Likes

Efficient Long-Term Trend Analysis in Presto Using Datelists

To make long-term trend analysis easier, we can leverage datelists, where we store each metric value corresponding to a date in an array in a sequential manner.

January 15, 2025

by Ajay Krishnan Prabhakaran

· 4,121 Views

Kafka vs NATS: A Comparison for Message Processing

Kafka and NATS are both popular tools for message processing. This article provides a comparison between Kafka and NATS.

January 15, 2025

by Josson Paul Kalapparambath

· 7,263 Views · 2 Likes

Consistency Conundrum: The Challenge of Keeping Data Aligned

Maintaining consistency is crucial to ensure a unified view of the data, which is essential for the correct functioning of distributed applications.

January 15, 2025

by Ammar Husain

CORE

· 2,452 Views

Bye Tokens, Hello Patches

Meta's BLT architecture is a better way to scale LLMs that may lead us to replace tokenization with a patches-based approach.

January 15, 2025

by mike labs

· 3,798 Views · 2 Likes

Data-First IDP: Driving AI Innovation in Developer Platforms

A Data-First IDP integrates governance, traceability, and quality into workflows, transforming how data is managed, enabling scalable, AI-ready ecosystems.

January 15, 2025

by Paul Gale

· 6,484 Views · 2 Likes

Personalized Search Optimization Using Semantic Models and Context-Aware NLP for Improved Results

This tutorial shows how to build a semantic search engine using Hugging Face transformers to deliver more accurate, context-aware results.

January 15, 2025

by Venkata Gummadi

· 7,337 Views · 1 Like

Distributed Training at Scale

Distributed training accelerates machine learning training by splitting tasks across multiple devices or machines, improving performance and scalability.

January 15, 2025

by Bhala Ranganathan

CORE

· 4,674 Views · 1 Like

A Guide to Microservices Deployment: Elastic Beanstalk vs Manual Setup

Learn how to deploy microservices with Elastic Beanstalk or EC2. Explore the pros, cons, and steps for both approaches to simplify or customize your setup.

January 15, 2025

by Praveen Kumar Thopalle

· 5,961 Views · 1 Like

Understanding DNS Records: What They Are and Why They Matter

Explore the essentials of DNS records: what they are, how they work, and why they are crucial for internet connectivity, security, and efficient web management.

January 14, 2025

by Earle Schaefer

· 3,163 Views · 2 Likes

The Importance of AI System Memory

The key to personalized AI intelligence is having scalable and controllable memory that can track and recall activities over a period of time.

January 14, 2025

by Bhala Ranganathan

CORE

· 4,582 Views · 2 Likes

AWS Nitro Enclaves: Enhancing Security With Isolated Compute Environments

AWS Nitro Enclaves are perfect for processing sensitive information and meeting compliance requirements while maintaining operational efficiency.

January 14, 2025

by Sajith Narayanan

· 14,091 Views · 1 Like

Router4j: A Free Alternative to Google Maps for Route and Distance Calculation

Router4j is a free and open-source tool for calculating routes and straight-line distances based on geographic coordinates — a free alternative to Google Maps.

January 14, 2025

by Thiago Nascimento

CORE

· 5,689 Views · 5 Likes