Data Engineering Resources

What Does It Take to Manage an On-Premise vs Cloud Data Security Product?

In this article, explore the major differences between an on-premise and a cloud data security product.

August 13, 2024

by Priyanka Neelakrishnan

· 14,832 Views · 2 Likes

Avoiding Prompt-Lock: Why Simply Swapping LLMs Can Lead to Failure

In this article unpack an issue that has the potential to wreak havoc on your ML initiatives: prompt lock-in.

August 13, 2024

by Luis Ceze

· 4,131 Views · 2 Likes

Building Product to Learn AI, Part 2: Shake and Bake

In part 1, we gathered the crucial "ingredients" for our AI creation — the data. Now, transform that data into a fully functioning Large Language Model (LLM).

August 13, 2024

by Obaid Sarvana

· 4,330 Views · 5 Likes

Neural Networks: From Perceptrons to Deep Learning

Explore in-depth the technical journey of neural networks, from the basic perceptron to advanced deep learning architectures driving AI innovations today.

August 13, 2024

by Fizza Jatniwala

· 4,209 Views · 2 Likes

DynamoDB: How to Move Out

Cover specific characteristics related to DynamoDB migrations and strategies employed to integrate with and migrate data seamlessly to other databases.

August 12, 2024

by Felipe Mendes

· 6,699 Views · 5 Likes

How to Document Your AWS Cloud Infrastructure Using Multicloud-Diagrams Framework

This article explores the importance of infrastructure diagrams, introduces the multicloud-diagrams framework, and explains the concept of Diagrams-as-code.

August 12, 2024

by Roman Tsypuk

· 4,064 Views · 1 Like

A Deep Dive Into Recommendation Algorithms With Netflix Case Study and NVIDIA Deep Learning Technology

Take a deep dive into recommendation algorithms that are crucial for internet platforms, driving user engagement and revenue, and used by major platforms.

August 12, 2024

by Sagar Sidana

· 8,544 Views · 2 Likes

OpenTelemetry Tracing on Spring Boot: Java Agent vs. Micrometer Tracing

In this post, compare three different ways to utilize OpenTelemtry Tracing and Spring Boot components: Java agent v1, Java agent v2, and Micrometer Tracing.

August 12, 2024

by Nicolas Fränkel

· 12,140 Views · 3 Likes

PostgreSQL Support for Large Object Replication

Create a two-node pgEdge cluster on the localhost to demonstrate how pgEdge Platform replicates large objects, share a native PSQL example, and more.

August 12, 2024

by Ahsan Hadi

· 5,417 Views · 1 Like

Data Fusion: Enhancing Interoperability, Privacy, and Security

Big Data alone isn't enough; quality and integration are key. Discover how data fusion enhances efficiency and decision-making in AI systems.

August 12, 2024

by Saigurudatta Pamulaparthyvenkata

· 4,020 Views · 3 Likes

Java Concurrency: The Happens-Before Guarantee

In this article, learn more about reorderings and multi-threaded codebases along with how Java helps you with its guarantees.

August 12, 2024

by Emmanouil Gkatziouras

CORE

· 13,588 Views · 14 Likes

Istio Ambient Mesh Performance Test and Benchmarking

Explore load test performance results of Istio Ambient and Istio sidecar service mesh with Kube CNI and Cilium CNI for DevOps and Cloud teams.

August 12, 2024

by Debasree Panda

· 8,064 Views · 1 Like

Apache Kafka + Flink + Snowflake: Cost-Efficient Analytics and Data Governance

Explore shift-left architecture with Snowflake, Apache Kafka, Flink, and Iceberg for cost-efficient analytics and data governance in the cloud.

August 10, 2024

by Kai Wähner

CORE

· 6,576 Views · 2 Likes

Demystifying the Magic: A Look Inside the Algorithms of Speech Recognition

Discover the mechanics that make speech recognition possible. Understanding the increasingly common voice-user interface (VUI) for applied AI could give you an edge.

August 9, 2024

by Manoj Boopathi Raj

· 5,012 Views · 1 Like

Why I Use RTK Query for API Calls in React

This article shares the architectural decisions, trade-offs, and lessons learned from building a system where every order triggers a multi-variable matching decision

August 9, 2024

by Bilal Azam

· 6,850 Views · 2 Likes

Use Mistral AI to Build Generative AI Applications With Go

Let's walk through how to use these Mistral AI models on Amazon Bedrock with Go, and in the process, also get a better understanding of its prompt tokens.

August 9, 2024

by Abhishek Gupta

CORE

· 6,462 Views · 1 Like

Content Detection Technologies in Data Loss Prevention (DLP) Products

Explore the key content detection technologies needed in a Data Loss Prevention (DLP) product developers need to focus on to develop a first-class solution.

August 9, 2024

by Priyanka Neelakrishnan

· 15,764 Views · 2 Likes

Connecting ChatGPT to Code Review Made Easy

GPT can generate code quite well, can it review it just as smoothly? Read this article to find out more.

August 9, 2024

by Dmytro Diachenko

· 6,172 Views · 2 Likes

The Case for Working on Non-Glamorous Migration Projects

Explore this contrary take on how to accelerate your journey to become a battle-hardened software developer/leader.

August 8, 2024

by Tejas Ghadge

· 18,093 Views · 7 Likes

Batch vs. Real-Time Processing: Understanding the Differences

Learn the differences between batch and real-time data processing, and explore the decision-making factors for choosing the right approach to optimize data pipelines.

August 8, 2024

by Stelios Manioudakis

CORE

· 17,708 Views · 4 Likes

The Latest Data Engineering Topics