Data Engineering Resources

New All-Flash Solutions To Streamline Data Management for AI and High-Volume Workloads

Quantum's all-flash solutions simplify data management for AI and high-volume workloads, offering high-performance storage and seamless integration.

April 29, 2024

by Tom Smith

CORE

· 2,007 Views · 1 Like

Turbocharge Innovation With Automated API Generation: Leveraging Automated API Generation for a Competitive Advantage

Amplify the potential of generative AI and low- and no-code platforms in API generation by highlighting their roles in fostering innovation and expediting time to market.

April 28, 2024

by Pratik Prakash

CORE

· 4,040 Views · 4 Likes

Get Some Rest! A Full API Stack

Explore options for building an API tech stack — from initial API design and documentation to API development, lifecycle management, security, monitoring, and more.

April 27, 2024

by Thomas Jardinet

CORE

· 4,978 Views · 7 Likes

Revisiting Observability: A Deep Dive Into the State of Monitoring, Costs, and Data Ownership in Today’s Market

Explore insights into the current challenges in monitoring, highlighting issues with instrumentation, pricing models, and data ownership.

April 26, 2024

by Mike Moore

· 2,893 Views · 3 Likes

Kubernetes: Future or Fad?

I don't think Kubernetes is yet another fad, but I strongly hope it's not going to be our future either. At least not in its current incarnation.

April 26, 2024

by Christoph Engelbert

· 2,785 Views · 2 Likes

Solving PostgreSQL Indexes, Partitioning, and LockManager Limitations

Read this blog to learn how to avoid the scalability limitations of PostgreSQL's partition-based approach by leveraging automatic sharding and global indexing.

April 26, 2024

by Franck Pachot

· 1,692 Views · 1 Like

Auto-Increment Columns in Apache Doris

Auto-increment columns in Apache Doris accelerate dictionary encoding and pagination without damaging data writing performance.

April 26, 2024

by Shirley H.

· 1,788 Views · 1 Like

Diffusion and Denoising: Explaining Text-To-Image Generative AI

Denoising diffusion models are trained to pull patterns out of noise, to generate a desirable image. This article illustrates the different ways to use diffusion.

April 26, 2024

by Kevin Vu

· 1,555 Views · 1 Like

Understanding API Technologies: A Comparative Analysis of REST, GraphQL, and Asynchronous APIs

Learn about the advantages vs. disadvantages and ideal use cases for REST, GraphQL, and Async APIs in this concise guide.

Updated April 26, 2024

by Saurabh Dashora

CORE

· 7,898 Views · 7 Likes

The Case for Choosing Between TCP and UDP for Data Transmission

The article compares TCP and UDP for data transmission, weighing reliability and sequential delivery of packets or fast speed and packet delivery in a stream.

April 26, 2024

by John Ejiofor

· 3,090 Views · 1 Like

Revolutionizing Business Intelligence: The Role of Explainable AI and Empowering Non-Technical Users

Explore the future of Business Intelligence (BI) with insights on explainable AI, empowering non-technical users, and the evolving role of data teams.

April 26, 2024

by Tom Smith

CORE

· 1,883 Views · 1 Like

Enhancing Web Scraping With Large Language Models: A Modern Approach

Explore the integration of Large Language Models (LLMs) with web scraping and the use of LLMs to efficiently transform complex HTML into structured JSON.

April 25, 2024

by Nacho Corcuera

· 7,397 Views · 3 Likes

Handling Vectors in AI Context via PostgreSQL pgVector

An introduction to PostgreSQL pgVector extension and its supported metrics — L2 squared distance (Euclidian), dot product, cosine distance/similarity.

April 25, 2024

by Horatiu Dan

CORE

· 1,793 Views · 5 Likes

VMware vSphere Backup Methods: Ensuring Data Safety and Recovery

Explore various backup methods available for VMware vSphere environments, how they function, and their respective advantages and limitations.

April 25, 2024

by Aditya Bhuyan

· 2,042 Views · 2 Likes

Monetizing Generative AI Starts With Metering

Establishing clear usage and utility telemetry from AI features justifies substantial development costs and cloud infrastructure investments.

April 25, 2024

by Jason English

· 1,447 Views · 1 Like

A Complete Guide to the Real-Time Streaming Protocol (RTSP)

RTSP enables control of media streaming sessions for IoT video applications like surveillance cameras. Here's everything you need to know.

April 25, 2024

by Carsten Rhod Gregersen

· 3,045 Views · 4 Likes

Leveraging All-Flash Object Storage for Accelerating AI and Massive Data Workloads

All-flash object storage accelerates AI pipelines and data lakes, delivering performance, scalability, and cost efficiency for massive unstructured data workloads.

April 25, 2024

by Tom Smith

CORE

· 2,018 Views · 1 Like

Java Container Application Memory Analysis

In this article, I cover types of memory usage for a Java container application and methods to analyze memory consumption.

April 24, 2024

by Parveen Saini

· 2,922 Views · 2 Likes

Understanding LLMs: Mixture of Experts

Mixture of Experts is a LLM architecture that powers your most popular LLMs. Continue reading to learn about how they work and why they work so well.

April 24, 2024

by Roger Oriol

· 1,338 Views · 1 Like

How To Integrate Weather Tracking Into Web Applications With PHP

To track weather using PHP, weather data from a reliable source is required. Several weather APIs are available that provide real-time and forecast weather information.

April 24, 2024

by Santosh Sahu

· 1,480 Views · 2 Likes

The Latest Data Engineering Topics