Data Engineering Resources

Plot Your REST Endpoints Using grafana-infinity-datasource

Plotting straight from the database is convenient, but is not always the case. Sometimes you might need something more complex that your API can support.

July 31, 2024

by Emmanouil Gkatziouras

CORE

· 5,647 Views · 2 Likes

Two-Tower Model for Fraud Detection: A Comprehensive Guide

Boost fraud detection with the two-tower model, a powerful architecture capturing complex relationships between transaction and user data.

July 31, 2024

by Gaurav Puri

· 4,779 Views · 3 Likes

Multimodal Search in AI Apps With PostgreSQL pgvector

This article demonstrates how you can add image and text-based search functionality to your AI applications using a multimodal LLM and PostgreSQL pgvector.

July 31, 2024

by Brett Hoyer

· 4,198 Views · 4 Likes

Outlier Identification in Continuous Data Streams With Z-Score and Modified Z-Score in a Moving Window

How do you spot outliers in continuous data streams? Learn to catch network performance hiccups effortlessly using z-score and modified z-score.

July 31, 2024

by Maksim Kupriianov

· 35,202 Views · 45 Likes

Automatic 1111: Adding Custom APIs

Following up on the last article that covered the fundamentals of Automatic 1111, let's take a look at the Options API and adding custom APIs.

July 31, 2024

by Tharakarama Reddy Yernapalli Sreenivasulu

· 4,607 Views · 7 Likes

Differentiating Rate Limits in Apache APISIX

Learn how to implement rate limiting with Apache APISIX: set the rate limit on a route, and move it to individual consumers and consumer groups.

July 31, 2024

by Nicolas Fränkel

· 3,709 Views · 2 Likes

Just Use PostgreSQL, a Quick-Start Guide: Exploring Essential and Extended Capabilities of the Most Beloved Database

Tour some of PostgreSQL's most notable capabilities and use cases, including various extensions for generative AI.

July 31, 2024

by Denis Magda

CORE

· 5,888 Views · 8 Likes

How to Generate Flame Graphs in Java

This article describes generating flame graphs in Java, discusses options, and in which use cases we could take advantage of it.

July 30, 2024

by Petr Bouda

CORE

· 10,084 Views · 7 Likes

GitOps: ArgoCD vs FluxCD

Discover the benefits of GitOps, explore a detailed comparison between ArgoCD and FluxCD, and learn how these tools streamline deployments and DevOps workflows.

July 30, 2024

by Unnati Mishra

· 7,702 Views · 4 Likes

How to Run Apache Spark on Kubernetes in Less Than 5 Minutes

Learn how to quickly set up and run Apache Spark on Kubernetes using Ilum for easier deployment, management, and scaling.

July 30, 2024

by Adam Lichtenstein

· 10,053 Views · 10 Likes

Implementing Multi-Level Caching in Java With NCache

Understanding the benefits of multi-level caching and setting up multi-level caching in Java using NCache — using it both as a distributed cache and a local cache.

July 30, 2024

by Abhinav Pandey

· 6,213 Views · 1 Like

Real-Time Anomaly Detection Using Large Language Models

Real-time anomaly detection using LLMs enhances accuracy for finance, healthcare, and cybersecurity through contextual analysis and pattern recognition.

July 30, 2024

by Harsh Daiya

CORE

· 11,779 Views · 3 Likes

Apache Iceberg Table Management

Apache Iceberg Table Management is essential to ensure smooth table operations by expiring/deleting unused data, metadata files.

July 30, 2024

by Rohit Kumar

· 3,065 Views · 1 Like

Enhancing Stream Data Processing With Snow Pipe, Cortex AI, and Snow Park

Customer sentiment analysis from reviews gathered from external source streams is ingested to Snowflake using Snow Pipe for further analysis using cortex AI API’s.

July 30, 2024

by Harshavardhan Yedla

· 3,488 Views · 3 Likes

Pivoting Database Systems Practices to AI: Create Efficient Development and Maintenance Practices With Generative AI

Explore how AI can revolutionize modern database development and maintenance through automation, real-time AI applications, and more.

July 30, 2024

by Anandaganesh Balakrishnan

· 7,179 Views · 4 Likes

How Kubernetes Changed the Networking Model and What Developers Should Know about eBPF and Cilium

Explore how Kubernetes transformed networking, the impact of eBPF and Cilium, and the future of network administration in this interview with Nicolas Vibert.

July 30, 2024

by Tom Smith

CORE

· 14,861 Views · 5 Likes

The Future of AI: Exploring Generative Systems and Large Language Models

Unleashing creativity and solving complex problems: the promise and challenges of generative AI and large language models.

July 30, 2024

by Saigurudatta Pamulaparthyvenkata

· 1,995 Views · 2 Likes

Using SingleStore for Iceberg Catalog Storage

SingleStore recently announced bi-directional support for Apache Iceberg. In this short article, we'll implement an Iceberg catalog using SingleStore and JDBC.

July 29, 2024

by Akmal Chaudhri

CORE

· 4,581 Views · 1 Like

Calm Down, Cloud's Not THAT Different!

Many network folks find the idea of learning cloud architecture daunting. The truth is that the two are more similar than they seem.

July 29, 2024

by Leon Adato

· 2,651 Views · 2 Likes

AIGenOps: Generative AI and Platform Engineering

In the domain of regulated software, especially in the banking environment where we work, there are constraints of security, quality, and network limitations.

July 29, 2024

by Nicolas Fantoni

· 3,285 Views · 6 Likes

The Latest Data Engineering Topics