Data Engineering Resources

Just Use PostgreSQL, a Quick-Start Guide: Exploring Essential and Extended Capabilities of the Most Beloved Database

Tour some of PostgreSQL's most notable capabilities and use cases, including various extensions for generative AI.

July 31, 2024

by Denis Magda

CORE

· 4,233 Views · 7 Likes

How to Generate Flame Graphs in Java

This article describes generating flame graphs in Java, discusses options, and in which use cases we could take advantage of it.

July 30, 2024

by Petr Bouda

CORE

· 7,912 Views · 7 Likes

GitOps: ArgoCD vs FluxCD

Discover the benefits of GitOps, explore a detailed comparison between ArgoCD and FluxCD, and learn how these tools streamline deployments and DevOps workflows.

July 30, 2024

by Unnati Mishra

· 6,512 Views · 4 Likes

How to Run Apache Spark on Kubernetes in Less Than 5 Minutes

Learn how to quickly set up and run Apache Spark on Kubernetes using Ilum for easier deployment, management, and scaling.

July 30, 2024

by Adam Lichtenstein

· 9,200 Views · 10 Likes

Implementing Multi-Level Caching in Java With NCache

Understanding the benefits of multi-level caching and setting up multi-level caching in Java using NCache — using it both as a distributed cache and a local cache.

July 30, 2024

by Abhinav Pandey

· 4,072 Views · 1 Like

Real-Time Anomaly Detection Using Large Language Models

Real-time anomaly detection using LLMs enhances accuracy for finance, healthcare, and cybersecurity through contextual analysis and pattern recognition.

July 30, 2024

by Harsh Daiya

CORE

· 5,553 Views · 3 Likes

Apache Iceberg Table Management

Apache Iceberg Table Management is essential to ensure smooth table operations by expiring/deleting unused data, metadata files.

July 30, 2024

by Rohit Kumar

· 2,091 Views · 1 Like

Enhancing Stream Data Processing With Snow Pipe, Cortex AI, and Snow Park

Customer sentiment analysis from reviews gathered from external source streams is ingested to Snowflake using Snow Pipe for further analysis using cortex AI API’s.

July 30, 2024

by Harshavardhan Yedla

· 2,291 Views · 3 Likes

Pivoting Database Systems Practices to AI: Create Efficient Development and Maintenance Practices With Generative AI

Explore how AI can revolutionize modern database development and maintenance through automation, real-time AI applications, and more.

July 30, 2024

by Anandaganesh Balakrishnan

· 5,975 Views · 4 Likes

How Kubernetes Changed the Networking Model and What Developers Should Know about eBPF and Cilium

Explore how Kubernetes transformed networking, the impact of eBPF and Cilium, and the future of network administration in this interview with Nicolas Vibert.

July 30, 2024

by Tom Smith

CORE

· 7,021 Views · 4 Likes

The Future of AI: Exploring Generative Systems and Large Language Models

Unleashing creativity and solving complex problems: the promise and challenges of generative AI and large language models.

July 30, 2024

by Saigurudatta Pamulaparthyvenkata

· 1,421 Views · 2 Likes

Using SingleStore for Iceberg Catalog Storage

SingleStore recently announced bi-directional support for Apache Iceberg. In this short article, we'll implement an Iceberg catalog using SingleStore and JDBC.

July 29, 2024

by Akmal Chaudhri

CORE

· 3,807 Views · 1 Like

Calm Down, Cloud's Not THAT Different!

Many network folks find the idea of learning cloud architecture daunting. The truth is that the two are more similar than they seem.

July 29, 2024

by Leon Adato

· 2,210 Views · 2 Likes

AIGenOps: Generative AI and Platform Engineering

In the domain of regulated software, especially in the banking environment where we work, there are constraints of security, quality, and network limitations.

July 29, 2024

by Nicolas Fantoni

· 2,729 Views · 6 Likes

Guarding Privacy: Cutting-Edge Technologies for Data Protection

Discover how advanced technologies are revolutionizing data security. Learn about encryption, blockchain, and machine learning in the fight against cyber threats.

July 29, 2024

by Saigurudatta Pamulaparthyvenkata

· 2,334 Views · 2 Likes

Automating Databases for Modern DevOps Practices: A Guide to Common Patterns and Anti-Patterns for Database Automation Techniques

By embracing AI, automation, database DevOps, and other emerging trends, organizations can ensure robust, efficient, and future-proofed database management practices.

July 29, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 5,877 Views · 9 Likes

Application-Level Tracing: The Good, the Bad, and the Alternative

Traditional app-level tracing was good up until a certain level. For complex troubleshooting, live debugging is taking the first seat in modern observability.

July 29, 2024

by Eran Kinsbruner

· 1,900 Views · 3 Likes

Implementing and Deploying a Real-Time AI-Powered Chatbot With Serverless Architecture

Build a real-time AI chatbot using AWS Lambda for the backend and a simple HTML/JavaScript frontend.

July 29, 2024

by Neha Dhaliwal

· 3,562 Views · 3 Likes

Enhancing Query Performance With AI and Vector Search in Azure Cosmos DB for PostgreSQL

Learn to enhance query performance using AI and vector search in Azure Cosmos DB for PostgreSQL, boosting data retrieval efficiency and accuracy.

July 29, 2024

by Sameer Danave

· 1,586 Views · 2 Likes

Why OOP Is a Bad Fit for Custom Software

Everything in programming is a trade-off. The combination of imperative and (DO)RY is the best one that results in more total code, but more maintainable code.

July 29, 2024

by Greg Hall

· 5,919 Views · 2 Likes

The Latest Data Engineering Topics