Data Engineering Resources

I don't think Kubernetes is yet another fad, but I strongly hope it's not going to be our future either. At least not in its current incarnation.

April 26, 2024

by Christoph Engelbert

· 2,407 Views · 2 Likes

Solving PostgreSQL Indexes, Partitioning, and LockManager Limitations

Read this blog to learn how to avoid the scalability limitations of PostgreSQL's partition-based approach by leveraging automatic sharding and global indexing.

April 26, 2024

by Franck Pachot

· 1,336 Views · 1 Like

Auto-Increment Columns in Apache Doris

Auto-increment columns in Apache Doris accelerate dictionary encoding and pagination without damaging data writing performance.

April 26, 2024

by Shirley H.

· 1,238 Views · 1 Like

Diffusion and Denoising: Explaining Text-To-Image Generative AI

Denoising diffusion models are trained to pull patterns out of noise, to generate a desirable image. This article illustrates the different ways to use diffusion.

April 26, 2024

by Kevin Vu

· 1,202 Views · 1 Like

Understanding API Technologies: A Comparative Analysis of REST, GraphQL, and Asynchronous APIs

Learn about the advantages vs. disadvantages and ideal use cases for REST, GraphQL, and Async APIs in this concise guide.

Updated April 26, 2024

by Saurabh Dashora

CORE

· 6,105 Views · 7 Likes

The Case for Choosing Between TCP and UDP for Data Transmission

The article compares TCP and UDP for data transmission, weighing reliability and sequential delivery of packets or fast speed and packet delivery in a stream.

April 26, 2024

by John Ejiofor

· 2,112 Views · 1 Like

Revolutionizing Business Intelligence: The Role of Explainable AI and Empowering Non-Technical Users

Explore the future of Business Intelligence (BI) with insights on explainable AI, empowering non-technical users, and the evolving role of data teams.

April 26, 2024

by Tom Smith

CORE

· 1,618 Views · 1 Like

Enhancing Web Scraping With Large Language Models: A Modern Approach

Explore the integration of Large Language Models (LLMs) with web scraping and the use of LLMs to efficiently transform complex HTML into structured JSON.

April 25, 2024

by Nacho Corcuera

· 4,867 Views · 3 Likes

Handling Vectors in AI Context via PostgreSQL pgVector

An introduction to PostgreSQL pgVector extension and its supported metrics — L2 squared distance (Euclidian), dot product, cosine distance/similarity.

April 25, 2024

by Horatiu Dan

· 1,157 Views · 1 Like

VMware vSphere Backup Methods: Ensuring Data Safety and Recovery

Explore various backup methods available for VMware vSphere environments, how they function, and their respective advantages and limitations.

April 25, 2024

by Aditya Bhuyan

· 1,614 Views · 2 Likes

Monetizing Generative AI Starts With Metering

Establishing clear usage and utility telemetry from AI features justifies substantial development costs and cloud infrastructure investments.

April 25, 2024

by Jason English

· 1,032 Views · 1 Like

A Complete Guide to the Real-Time Streaming Protocol (RTSP)

RTSP enables control of media streaming sessions for IoT video applications like surveillance cameras. Here's everything you need to know.

April 25, 2024

by Carsten Rhod Gregersen

· 2,522 Views · 4 Likes

Leveraging All-Flash Object Storage for Accelerating AI and Massive Data Workloads

All-flash object storage accelerates AI pipelines and data lakes, delivering performance, scalability, and cost efficiency for massive unstructured data workloads.

April 25, 2024

by Tom Smith

CORE

· 1,630 Views · 1 Like

Java Container Application Memory Analysis

In this article, I cover types of memory usage for a Java container application and methods to analyze memory consumption.

April 24, 2024

by Parveen Saini

· 1,868 Views · 2 Likes

Understanding LLMs: Mixture of Experts

Mixture of Experts is a LLM architecture that powers your most popular LLMs. Continue reading to learn about how they work and why they work so well.

April 24, 2024

by Roger Oriol

· 859 Views · 1 Like

How To Integrate Weather Tracking Into Web Applications With PHP

To track weather using PHP, weather data from a reliable source is required. Several weather APIs are available that provide real-time and forecast weather information.

April 24, 2024

by Santosh Sahu

· 1,127 Views · 2 Likes