Data Engineering Resources

Virtual Clusters: The Key to Taming Cloud Costs in the Kubernetes Era

In this interview, learn how virtual clusters impact cloud cost management, offering efficiency and flexibility for K8s deployments in today's economic climate.

August 13, 2024

by Tom Smith

CORE

· 8,296 Views · 3 Likes

Why and How We Built a Primary-Replica Architecture of ClickHouse

Take a deep dive into the challenges and solutions one company experienced while implementing a primary-replica architecture for ClickHouse.

August 13, 2024

by Tao Ma

· 5,200 Views · 3 Likes

What Does It Take to Manage an On-Premise vs Cloud Data Security Product?

In this article, explore the major differences between an on-premise and a cloud data security product.

August 13, 2024

by Priyanka Neelakrishnan

· 14,719 Views · 2 Likes

Avoiding Prompt-Lock: Why Simply Swapping LLMs Can Lead to Failure

In this article unpack an issue that has the potential to wreak havoc on your ML initiatives: prompt lock-in.

August 13, 2024

by Luis Ceze

· 3,952 Views · 2 Likes

Building Product to Learn AI, Part 2: Shake and Bake

In part 1, we gathered the crucial "ingredients" for our AI creation — the data. Now, transform that data into a fully functioning Large Language Model (LLM).

August 13, 2024

by Obaid Sarvana

· 4,203 Views · 5 Likes

Neural Networks: From Perceptrons to Deep Learning

Explore in-depth the technical journey of neural networks, from the basic perceptron to advanced deep learning architectures driving AI innovations today.

August 13, 2024

by Fizza Jatniwala

· 4,027 Views · 2 Likes

DynamoDB: How to Move Out

Cover specific characteristics related to DynamoDB migrations and strategies employed to integrate with and migrate data seamlessly to other databases.

August 12, 2024

by Felipe Mendes

· 6,615 Views · 4 Likes

How to Document Your AWS Cloud Infrastructure Using Multicloud-Diagrams Framework

This article explores the importance of infrastructure diagrams, introduces the multicloud-diagrams framework, and explains the concept of Diagrams-as-code.

August 12, 2024

by Roman Tsypuk

· 3,881 Views · 1 Like

A Deep Dive Into Recommendation Algorithms With Netflix Case Study and NVIDIA Deep Learning Technology

Take a deep dive into recommendation algorithms that are crucial for internet platforms, driving user engagement and revenue, and used by major platforms.

August 12, 2024

by Sagar Sidana

· 8,061 Views · 2 Likes

OpenTelemetry Tracing on Spring Boot: Java Agent vs. Micrometer Tracing

In this post, compare three different ways to utilize OpenTelemtry Tracing and Spring Boot components: Java agent v1, Java agent v2, and Micrometer Tracing.

August 12, 2024

by Nicolas Fränkel

· 11,936 Views · 3 Likes

PostgreSQL Support for Large Object Replication

Create a two-node pgEdge cluster on the localhost to demonstrate how pgEdge Platform replicates large objects, share a native PSQL example, and more.

August 12, 2024

by Ahsan Hadi

· 5,321 Views · 1 Like

Data Fusion: Enhancing Interoperability, Privacy, and Security

Big Data alone isn't enough; quality and integration are key. Discover how data fusion enhances efficiency and decision-making in AI systems.

August 12, 2024

by Saigurudatta Pamulaparthyvenkata

· 3,906 Views · 2 Likes

Java Concurrency: The Happens-Before Guarantee

In this article, learn more about reorderings and multi-threaded codebases along with how Java helps you with its guarantees.

August 12, 2024

by Emmanouil Gkatziouras

CORE

· 13,301 Views · 14 Likes

Istio Ambient Mesh Performance Test and Benchmarking

Explore load test performance results of Istio Ambient and Istio sidecar service mesh with Kube CNI and Cilium CNI for DevOps and Cloud teams.

August 12, 2024

by Debasree Panda

· 7,933 Views · 1 Like

Apache Kafka + Flink + Snowflake: Cost-Efficient Analytics and Data Governance

Explore shift-left architecture with Snowflake, Apache Kafka, Flink, and Iceberg for cost-efficient analytics and data governance in the cloud.

August 10, 2024

by Kai Wähner

CORE

· 6,456 Views · 1 Like

Demystifying the Magic: A Look Inside the Algorithms of Speech Recognition

Discover the mechanics that make speech recognition possible. Understanding the increasingly common voice-user interface (VUI) for applied AI could give you an edge.

August 9, 2024

by Manoj Boopathi Raj

· 4,820 Views · 1 Like

Why I Use RTK Query for API Calls in React

This article shares the architectural decisions, trade-offs, and lessons learned from building a system where every order triggers a multi-variable matching decision

August 9, 2024

by Bilal Azam

· 6,745 Views · 2 Likes

Use Mistral AI to Build Generative AI Applications With Go

Let's walk through how to use these Mistral AI models on Amazon Bedrock with Go, and in the process, also get a better understanding of its prompt tokens.

August 9, 2024

by Abhishek Gupta

CORE

· 6,274 Views · 1 Like

Content Detection Technologies in Data Loss Prevention (DLP) Products

Explore the key content detection technologies needed in a Data Loss Prevention (DLP) product developers need to focus on to develop a first-class solution.

August 9, 2024

by Priyanka Neelakrishnan

· 15,595 Views · 2 Likes

Connecting ChatGPT to Code Review Made Easy

GPT can generate code quite well, can it review it just as smoothly? Read this article to find out more.

August 9, 2024

by Dmytro Diachenko

· 6,005 Views · 1 Like

The Latest Data Engineering Topics