Data Engineering Resources

Why and How We Built a Primary-Replica Architecture of ClickHouse

Take a deep dive into the challenges and solutions one company experienced while implementing a primary-replica architecture for ClickHouse.

August 13, 2024

by Tao Ma

· 4,243 Views · 3 Likes

What Does It Take to Manage an On-Premise vs Cloud Data Security Product?

In this article, explore the major differences between an on-premise and a cloud data security product.

August 13, 2024

by Priyanka Neelakrishnan

· 13,885 Views · 2 Likes

Avoiding Prompt-Lock: Why Simply Swapping LLMs Can Lead to Failure

In this article unpack an issue that has the potential to wreak havoc on your ML initiatives: prompt lock-in.

August 13, 2024

by Luis Ceze

· 2,397 Views · 2 Likes

Building Product to Learn AI, Part 2: Shake and Bake

In part 1, we gathered the crucial "ingredients" for our AI creation — the data. Now, transform that data into a fully functioning Large Language Model (LLM).

August 13, 2024

by Obaid Sarvana

· 3,302 Views · 5 Likes

Neural Networks: From Perceptrons to Deep Learning

Explore in-depth the technical journey of neural networks, from the basic perceptron to advanced deep learning architectures driving AI innovations today.

August 13, 2024

by Fizza Jatniwala

· 2,199 Views · 2 Likes

DynamoDB: How to Move Out

Cover specific characteristics related to DynamoDB migrations and strategies employed to integrate with and migrate data seamlessly to other databases.

August 12, 2024

by Felipe Mendes

· 5,683 Views · 4 Likes

How to Document Your AWS Cloud Infrastructure Using Multicloud-Diagrams Framework

This article explores the importance of infrastructure diagrams, introduces the multicloud-diagrams framework, and explains the concept of Diagrams-as-code.

August 12, 2024

by Roman Tsypuk

· 2,631 Views · 1 Like

A Deep Dive Into Recommendation Algorithms With Netflix Case Study and NVIDIA Deep Learning Technology

Take a deep dive into recommendation algorithms that are crucial for internet platforms, driving user engagement and revenue, and used by major platforms.

August 12, 2024

by Sagar Sidana

· 2,166 Views · 2 Likes

OpenTelemetry Tracing on Spring Boot: Java Agent vs. Micrometer Tracing

In this post, compare three different ways to utilize OpenTelemtry Tracing and Spring Boot components: Java agent v1, Java agent v2, and Micrometer Tracing.

August 12, 2024

by Nicolas Fränkel

CORE

· 9,587 Views · 3 Likes

PostgreSQL Support for Large Object Replication

Create a two-node pgEdge cluster on the localhost to demonstrate how pgEdge Platform replicates large objects, share a native PSQL example, and more.

August 12, 2024

by Ahsan Hadi

· 4,627 Views · 1 Like

Data Fusion: Enhancing Interoperability, Privacy, and Security

Big Data alone isn't enough; quality and integration are key. Discover how data fusion enhances efficiency and decision-making in AI systems.

August 12, 2024

by Saigurudatta Pamulaparthyvenkata

· 2,784 Views · 2 Likes

Java Concurrency: The Happens-Before Guarantee

In this article, learn more about reorderings and multi-threaded codebases along with how Java helps you with its guarantees.

August 12, 2024

by Emmanouil Gkatziouras

CORE

· 10,882 Views · 13 Likes

Istio Ambient Mesh Performance Test and Benchmarking

Explore load test performance results of Istio Ambient and Istio sidecar service mesh with Kube CNI and Cilium CNI for DevOps and Cloud teams.

August 12, 2024

by Debasree Panda

· 6,104 Views · 1 Like

Apache Kafka + Flink + Snowflake: Cost-Efficient Analytics and Data Governance

Explore shift-left architecture with Snowflake, Apache Kafka, Flink, and Iceberg for cost-efficient analytics and data governance in the cloud.

August 10, 2024

by Kai Wähner

CORE

· 5,311 Views · 1 Like

Demystifying the Magic: A Look Inside the Algorithms of Speech Recognition

Discover the mechanics that make speech recognition possible. Understanding the increasingly common voice-user interface (VUI) for applied AI could give you an edge.

August 9, 2024

by Manoj Boopathi Raj

· 3,517 Views · 1 Like

Why I Use RTK Query for API Calls in React

The RTK Query part of the Redux Essentials tutorial is phenomenal, but as part of a larger suite of documentation, the gem that is RTK Query is getting lost.

August 9, 2024

by Bilal Azam

· 5,894 Views · 2 Likes

Use Mistral AI to Build Generative AI Applications With Go

Let's walk through how to use these Mistral AI models on Amazon Bedrock with Go, and in the process, also get a better understanding of its prompt tokens.

August 9, 2024

by Abhishek Gupta

CORE

· 4,821 Views · 1 Like

Content Detection Technologies in Data Loss Prevention (DLP) Products

Explore the key content detection technologies needed in a Data Loss Prevention (DLP) product developers need to focus on to develop a first-class solution.

August 9, 2024

by Priyanka Neelakrishnan

· 14,190 Views · 2 Likes

Connecting ChatGPT to Code Review Made Easy

GPT can generate code quite well, can it review it just as smoothly? Read this article to find out more.

August 9, 2024

by Dmytro Diachenko

· 3,826 Views · 1 Like

The Case for Working on Non-Glamorous Migration Projects

Explore this contrary take on how to accelerate your journey to become a battle-hardened software developer/leader.

August 8, 2024

by Tejas Ghadge

· 16,667 Views · 6 Likes

The Latest Data Engineering Topics