Data Engineering Resources

Cover specific characteristics related to DynamoDB migrations and strategies employed to integrate with and migrate data seamlessly to other databases.

August 12, 2024

by Felipe Mendes

· 6,479 Views · 4 Likes

How to Document Your AWS Cloud Infrastructure Using Multicloud-Diagrams Framework

This article explores the importance of infrastructure diagrams, introduces the multicloud-diagrams framework, and explains the concept of Diagrams-as-code.

August 12, 2024

by Roman Tsypuk

· 3,714 Views · 1 Like

A Deep Dive Into Recommendation Algorithms With Netflix Case Study and NVIDIA Deep Learning Technology

Take a deep dive into recommendation algorithms that are crucial for internet platforms, driving user engagement and revenue, and used by major platforms.

August 12, 2024

by Sagar Sidana

· 7,478 Views · 2 Likes

OpenTelemetry Tracing on Spring Boot: Java Agent vs. Micrometer Tracing

In this post, compare three different ways to utilize OpenTelemtry Tracing and Spring Boot components: Java agent v1, Java agent v2, and Micrometer Tracing.

August 12, 2024

by Nicolas Fränkel

· 11,740 Views · 3 Likes

PostgreSQL Support for Large Object Replication

Create a two-node pgEdge cluster on the localhost to demonstrate how pgEdge Platform replicates large objects, share a native PSQL example, and more.

August 12, 2024

by Ahsan Hadi

· 5,200 Views · 1 Like

Data Fusion: Enhancing Interoperability, Privacy, and Security

Big Data alone isn't enough; quality and integration are key. Discover how data fusion enhances efficiency and decision-making in AI systems.

August 12, 2024

by Saigurudatta Pamulaparthyvenkata

· 3,765 Views · 2 Likes

Java Concurrency: The Happens-Before Guarantee

In this article, learn more about reorderings and multi-threaded codebases along with how Java helps you with its guarantees.

August 12, 2024

by Emmanouil Gkatziouras

CORE

· 12,968 Views · 14 Likes

Istio Ambient Mesh Performance Test and Benchmarking

Explore load test performance results of Istio Ambient and Istio sidecar service mesh with Kube CNI and Cilium CNI for DevOps and Cloud teams.

August 12, 2024

by Debasree Panda

· 7,783 Views · 1 Like

Apache Kafka + Flink + Snowflake: Cost-Efficient Analytics and Data Governance

Explore shift-left architecture with Snowflake, Apache Kafka, Flink, and Iceberg for cost-efficient analytics and data governance in the cloud.

August 10, 2024

by Kai Wähner

CORE

· 6,266 Views · 1 Like

Demystifying the Magic: A Look Inside the Algorithms of Speech Recognition

Discover the mechanics that make speech recognition possible. Understanding the increasingly common voice-user interface (VUI) for applied AI could give you an edge.

August 9, 2024

by Manoj Boopathi Raj

· 4,682 Views · 1 Like

Why I Use RTK Query for API Calls in React

This article shares the architectural decisions, trade-offs, and lessons learned from building a system where every order triggers a multi-variable matching decision

August 9, 2024

by Bilal Azam

· 6,659 Views · 2 Likes

Use Mistral AI to Build Generative AI Applications With Go

Let's walk through how to use these Mistral AI models on Amazon Bedrock with Go, and in the process, also get a better understanding of its prompt tokens.

August 9, 2024

by Abhishek Gupta

CORE

· 6,087 Views · 1 Like

Content Detection Technologies in Data Loss Prevention (DLP) Products

Explore the key content detection technologies needed in a Data Loss Prevention (DLP) product developers need to focus on to develop a first-class solution.

August 9, 2024

by Priyanka Neelakrishnan

· 15,448 Views · 2 Likes

Connecting ChatGPT to Code Review Made Easy

GPT can generate code quite well, can it review it just as smoothly? Read this article to find out more.

August 9, 2024

by Dmytro Diachenko

· 5,811 Views · 1 Like

The Case for Working on Non-Glamorous Migration Projects

Explore this contrary take on how to accelerate your journey to become a battle-hardened software developer/leader.

August 8, 2024

by Tejas Ghadge

· 17,761 Views · 7 Likes

Batch vs. Real-Time Processing: Understanding the Differences

Learn the differences between batch and real-time data processing, and explore the decision-making factors for choosing the right approach to optimize data pipelines.

August 8, 2024

by Stelios Manioudakis

CORE

· 16,954 Views · 3 Likes

Apache Flink 101: A Guide for Developers

Learn more about Apache Flink, a powerful stream processing tool, for building streaming data pipelines, real-time analytics, and event-driven applications.

August 8, 2024

by David Anderson

· 9,541 Views · 2 Likes

How to Create a CRUD Application in Less Than 15 Minutes

This step-by-step guide explores how to create a front end for your database with Java only, without any JavaScript knowledge needed.

August 8, 2024

by Amir Shelli

· 18,557 Views · 8 Likes

Running PyTorch on GPUs

This summary of steps to run the PyTorch framework or any AI workload on GPUs highlights the importance of the hardware, driver, software, and frameworks.

August 8, 2024

by Jagadish Krishnamoorthy

· 7,979 Views · 2 Likes

How to Scale RAG and Build More Accurate LLMs

Retrieval augmented generation (RAG) needs the right data architecture to scale efficiently. Learn how data streaming helps data and application teams innovate.

August 8, 2024

by Andrew Sellers

· 3,669 Views · 2 Likes

The Latest Data Engineering Topics