Data Engineering Resources

OpenTelemetry Tracing on Spring Boot: Java Agent vs. Micrometer Tracing

In this post, compare three different ways to utilize OpenTelemtry Tracing and Spring Boot components: Java agent v1, Java agent v2, and Micrometer Tracing.

August 12, 2024

by Nicolas Fränkel

CORE

· 9,624 Views · 3 Likes

PostgreSQL Support for Large Object Replication

Create a two-node pgEdge cluster on the localhost to demonstrate how pgEdge Platform replicates large objects, share a native PSQL example, and more.

August 12, 2024

by Ahsan Hadi

· 4,653 Views · 1 Like

Data Fusion: Enhancing Interoperability, Privacy, and Security

Big Data alone isn't enough; quality and integration are key. Discover how data fusion enhances efficiency and decision-making in AI systems.

August 12, 2024

by Saigurudatta Pamulaparthyvenkata

· 2,826 Views · 2 Likes

Java Concurrency: The Happens-Before Guarantee

In this article, learn more about reorderings and multi-threaded codebases along with how Java helps you with its guarantees.

August 12, 2024

by Emmanouil Gkatziouras

CORE

· 11,004 Views · 13 Likes

Istio Ambient Mesh Performance Test and Benchmarking

Explore load test performance results of Istio Ambient and Istio sidecar service mesh with Kube CNI and Cilium CNI for DevOps and Cloud teams.

August 12, 2024

by Debasree Panda

· 6,154 Views · 1 Like

Apache Kafka + Flink + Snowflake: Cost-Efficient Analytics and Data Governance

Explore shift-left architecture with Snowflake, Apache Kafka, Flink, and Iceberg for cost-efficient analytics and data governance in the cloud.

August 10, 2024

by Kai Wähner

CORE

· 5,350 Views · 1 Like

Demystifying the Magic: A Look Inside the Algorithms of Speech Recognition

Discover the mechanics that make speech recognition possible. Understanding the increasingly common voice-user interface (VUI) for applied AI could give you an edge.

August 9, 2024

by Manoj Boopathi Raj

· 3,544 Views · 1 Like

Why I Use RTK Query for API Calls in React

The RTK Query part of the Redux Essentials tutorial is phenomenal, but as part of a larger suite of documentation, the gem that is RTK Query is getting lost.

August 9, 2024

by Bilal Azam

· 5,944 Views · 2 Likes

Use Mistral AI to Build Generative AI Applications With Go

Let's walk through how to use these Mistral AI models on Amazon Bedrock with Go, and in the process, also get a better understanding of its prompt tokens.

August 9, 2024

by Abhishek Gupta

CORE

· 4,847 Views · 1 Like

Content Detection Technologies in Data Loss Prevention (DLP) Products

Explore the key content detection technologies needed in a Data Loss Prevention (DLP) product developers need to focus on to develop a first-class solution.

August 9, 2024

by Priyanka Neelakrishnan

· 14,552 Views · 2 Likes

Connecting ChatGPT to Code Review Made Easy

GPT can generate code quite well, can it review it just as smoothly? Read this article to find out more.

August 9, 2024

by Dmytro Diachenko

· 3,869 Views · 1 Like

The Case for Working on Non-Glamorous Migration Projects

Explore this contrary take on how to accelerate your journey to become a battle-hardened software developer/leader.

August 8, 2024

by Tejas Ghadge

· 16,706 Views · 7 Likes

Batch vs. Real-Time Processing: Understanding the Differences

Learn the differences between batch and real-time data processing, and explore the decision-making factors for choosing the right approach to optimize data pipelines.

August 8, 2024

by Stelios Manioudakis, PhD

CORE

· 13,712 Views · 2 Likes

Apache Flink 101: A Guide for Developers

Learn more about Apache Flink, a powerful stream processing tool, for building streaming data pipelines, real-time analytics, and event-driven applications.

August 8, 2024

by David Anderson

· 7,120 Views · 2 Likes

How to Create a CRUD Application in Less Than 15 Minutes

This step-by-step guide explores how to create a front end for your database with Java only, without any JavaScript knowledge needed.

August 8, 2024

by Amir Shelli

· 16,797 Views · 8 Likes

Running PyTorch on GPUs

This summary of steps to run the PyTorch framework or any AI workload on GPUs highlights the importance of the hardware, driver, software, and frameworks.

August 8, 2024

by Jagadish Krishnamoorthy

· 6,886 Views · 2 Likes

How to Scale RAG and Build More Accurate LLMs

Retrieval augmented generation (RAG) needs the right data architecture to scale efficiently. Learn how data streaming helps data and application teams innovate.

August 8, 2024

by Andrew Sellers

· 3,002 Views · 2 Likes

Leveraging Snowflake’s AI/ML Capabilities for Anomaly Detection

Explore the AI/ML capabilities of Snowflake, focusing on leveraging the SNOWFLAKE.ML.ANOMALY_DETECTION function to detect anomalies in superstore sales.

August 8, 2024

by Kapil Kumar Sharma

· 4,094 Views · 1 Like

Semi-Supervised Learning: How to Overcome the Lack of Labels

Dive into the concept of semi-supervised learning and explore its principles, applications, and potential to revolutionize how we approach data-hungry ML tasks.

August 7, 2024

by Aleksandr Timashov

· 38,816 Views · 49 Likes

10 Kubernetes Cost Optimization Techniques

In this article, learn 10 ways to drive down Kubernetes costs, whether you are adopting a new architecture or optimizing an existing environment.

August 7, 2024

by Andromeda Booth

· 8,829 Views · 5 Likes

The Latest Data Engineering Topics