Data Engineering Resources

The Case for Choosing Between TCP and UDP for Data Transmission

The article compares TCP and UDP for data transmission, weighing reliability and sequential delivery of packets or fast speed and packet delivery in a stream.

April 26, 2024

by John Ejiofor

· 1,931 Views · 1 Like

Revolutionizing Business Intelligence: The Role of Explainable AI and Empowering Non-Technical Users

Explore the future of Business Intelligence (BI) with insights on explainable AI, empowering non-technical users, and the evolving role of data teams.

April 26, 2024

by Tom Smith

CORE

· 1,501 Views · 1 Like

Enhancing Web Scraping With Large Language Models: A Modern Approach

Explore the integration of Large Language Models (LLMs) with web scraping and the use of LLMs to efficiently transform complex HTML into structured JSON.

April 25, 2024

by Nacho Corcuera

· 4,015 Views · 3 Likes

Handling Vectors in AI Context via PostgreSQL pgVector

An introduction to PostgreSQL pgVector extension and its supported metrics — L2 squared distance (Euclidian), dot product, cosine distance/similarity.

April 25, 2024

by Horatiu Dan

· 1,053 Views · 1 Like

VMware vSphere Backup Methods: Ensuring Data Safety and Recovery

Explore various backup methods available for VMware vSphere environments, how they function, and their respective advantages and limitations.

April 25, 2024

by Aditya Bhuyan

· 1,426 Views · 2 Likes

Monetizing Generative AI Starts With Metering

Establishing clear usage and utility telemetry from AI features justifies substantial development costs and cloud infrastructure investments.

April 25, 2024

by Jason English

· 911 Views · 1 Like

A Complete Guide to the Real-Time Streaming Protocol (RTSP)

RTSP enables control of media streaming sessions for IoT video applications like surveillance cameras. Here's everything you need to know.

April 25, 2024

by Carsten Rhod Gregersen

· 2,111 Views · 4 Likes

Leveraging All-Flash Object Storage for Accelerating AI and Massive Data Workloads

All-flash object storage accelerates AI pipelines and data lakes, delivering performance, scalability, and cost efficiency for massive unstructured data workloads.

April 25, 2024

by Tom Smith

CORE

· 1,436 Views · 1 Like

Java Container Application Memory Analysis

In this article, I cover types of memory usage for a Java container application and methods to analyze memory consumption.

April 24, 2024

by Parveen Saini

· 1,620 Views · 2 Likes

Understanding LLMs: Mixture of Experts

Mixture of Experts is a LLM architecture that powers your most popular LLMs. Continue reading to learn about how they work and why they work so well.

April 24, 2024

by Roger Oriol

· 745 Views · 1 Like

How To Integrate Weather Tracking Into Web Applications With PHP

To track weather using PHP, weather data from a reliable source is required. Several weather APIs are available that provide real-time and forecast weather information.

April 24, 2024

by Santosh Sahu

· 1,019 Views · 2 Likes

How To Build Generative AI Apps on AWS Using Anthropic Claude 3

Explore building generative AI applications using Anthropic Claude 3 on AWS. Discover cloud-based AI innovation and advanced techniques in our guide.

April 24, 2024

by Nisar Ahmad

· 1,617 Views · 3 Likes

HTTP API: Key Skills for Smooth Integration and Operation (Part 1)

In this article, I want to share my experience on how to work properly with HTTP APIs of third-party or internal services

April 24, 2024

by Filipp Shcherbanich

· 1,503 Views · 3 Likes

Debugging Terraform Like a Pro: Strategies for Efficient Infrastructure Management

Mastering debugging in Terraform by identifying and resolving issues in Terraform configurations, states, and workflows.

April 24, 2024

by Josephine Eskaline Joyce

CORE

· 1,936 Views · 4 Likes

Starburst Unveils Fully Managed 'Icehouse' for Near Real-Time Analytics on the Open Data Lakehouse

Icehouse on Galaxy simplifies data analytics, reduces costs, and enables AI/ML workloads with an open data lakehouse architecture.

April 24, 2024

by Tom Smith

CORE

· 1,467 Views · 2 Likes

A Comparative Exploration of LLM and RAG Technologies: Shaping the Future of AI

Follow a comparative journey between LLM and RAG, shedding light on their mechanisms, applications, and the unique advantages they offer to the AI field.

April 24, 2024

by Ashok Gorantla

CORE

· 21,086 Views · 6 Likes

Why Do Data Teams Need To Adopt “Product Thinking”?

Explore the evolving landscape of Product Management in data teams and how adopting a product mindset is key for Data Product success.

April 23, 2024

by Yuliia Tkachova

· 299 Views · 1 Like

How To Work Effectively With JDBC in Java Scripts

This article demonstrates how to streamline SQL queries in Java scripts using a single class, resulting in safer, more concise code with better readability.

April 23, 2024

by Pavel Ponec

· 1,829 Views · 4 Likes

A Discussion on Managing Vulnerabilities

Breaches are common due to unpatched vulnerabilities. Learn why a strong vulnerability management program is crucial for any security strategy.

April 23, 2024

by Tchule Ribeiro

· 460 Views · 1 Like

PostGIS and Heroku Postgres: Location, Location, Location!

Learn how to get a PostGIS-enabled Postgres instance running on Heroku and run some sample queries on the database.

April 23, 2024

by Joseph Caudle

· 602 Views · 2 Likes

The Latest Data Engineering Topics