Data Engineering Resources

In this article, learn how you can deploy your Heroku app automatically any time code is merged into your main branch by using GitLab CI/CD.

March 21, 2024

by Tyler Hawkins

CORE

· 11,606 Views · 2 Likes

Those Were The Days?! A Humorous Reflection on the Evolution of Software Engineering

Writing software is ever more complicated, but have you ever wondered what it was like before all the tools and technology we have today? You may regret asking!

March 21, 2024

by Scott Sosna

CORE

· 6,783 Views · 5 Likes

Vector Tutorial: Conducting Similarity Search in Enterprise Data

Harness the power of word vectors and similarity searches to help discover data correlations with enterprise data to assist with a marketing campaign.

March 21, 2024

by John Vester

CORE

· 50,773 Views · 4 Likes

How to Query XML Files Using APIs in Java

With XQuery, quickly filter and aggregate XML content with a simple expression. Learn how to easily query files with XQuery expressions at scale.

March 21, 2024

by Brian O'Neill

CORE

· 11,934 Views · 5 Likes

Do We Need Data Normalization Anymore?

Data normalization is supposed to be the way you optimize databases to ensure their integrity. But maybe with many databases, normalization becomes redundant.

March 21, 2024

by Jennifer Reif

CORE

· 9,348 Views · 6 Likes

New Tools and Platforms To Accelerate Generative AI Development

NVIDIA unveils Blackwell GPU, NIM microservices, Omniverse APIs, and partnerships simplify generative AI development for enterprise, robotics, and quantum computing.

March 21, 2024

by Tom Smith

CORE

· 3,415 Views · 1 Like

An In-Depth Analysis of GraphQL Functioning Using GenAI Within a Monolithic Application Framework

In a monolithic application, where all components are interwoven into a single software unit, GraphQL offers a unique approach to manage and manipulate data.

March 21, 2024

by Elias Naduvath Varghese

· 7,213 Views · 1 Like

Implement RAG Using Weaviate, LangChain4j, and LocalAI

In this blog, you will learn how to implement Retrieval Augmented Generation (RAG) using Weaviate, LangChain4j and LocalAI.

March 21, 2024

by Gunter Rotsaert

CORE

· 4,241 Views · 3 Likes

Data Processing in GCP With Apache Airflow and BigQuery

Efficient data processing is paramount. In this guide, we'll explore how to leverage Apache Airflow and BigQuery to create robust and scalable data pipelines.

March 20, 2024

by Sreenath Devineni

CORE

· 16,486 Views · 5 Likes

The Data Streaming Landscape 2024

This article presents a comparison of open-source Apache Kafka and Flink stream processing products, cloud, competition, and market trends.

March 20, 2024

by Kai Wähner

CORE

· 9,263 Views · 2 Likes

Securing Cloud Infrastructure: Leveraging Key Management Technologies

This article explores the world of secure key management, the intricacies of KMS and HSM, their benefits, use cases, key considerations, and best practices.

March 20, 2024

by Josephine Eskaline Joyce

CORE

· 10,158 Views · 4 Likes

API Governance: Ensuring Control and Compliance in the Era of Digital Transformation

This comprehensive article explores the significance of API governance, its key components, and best practices for implementation.

March 20, 2024

by Lakshmi Sushma Daggubati

· 9,079 Views · 1 Like

PostgresML: Streamlining AI Model Deployment With PostgreSQL Integration

By embracing PostgresML, organizations can tap into the power of AI-driven insights and gain a competitive edge in today's data-centric landscape.

March 20, 2024

by Pankaj Zanke

· 11,032 Views · 2 Likes

SOC 2 Audits as a Pillar of Data Accountability

SOC 2 audits are critical for cloud data security, ensuring companies meet standards for managing customer data with a focus on security, availability, and privacy.

March 20, 2024

by Suhas Jangoan

· 7,634 Views · 2 Likes

Graphs and Language

This comprehensive blog is a written transcription of Louis Guitton's talk at a recent conference, where he shared his insights around knowledge on Graph RAG and LLMs.

March 20, 2024

by Louis Guitton

· 2,281 Views · 1 Like

Introduction to KVM, SR-IOV, and Exploring the Advantages of SR-IOV in KVM Environments

KVM is a powerful virtualization technology integrated into the Linux kernel, allowing physical servers to host VMs efficiently.

March 20, 2024

by Prashanth Ravula

CORE

· 17,348 Views · 3 Likes

API Appliance for Extreme Agility and Simplicity

Use API Logic Server to create an API-based web app in minutes and add message-based integration, all with little knowledge of frameworks or Python.

March 20, 2024

by Val Huber

CORE

· 11,377 Views · 7 Likes

The Impact of Biometric Authentication on User Privacy and the Role of Blockchain in Preserving Secure Data

Blockchain technology is a novel solution to privacy concerns and risks associated with the storage and maintenance of biometric data.

March 20, 2024

by Saurav Bhattacharya

· 6,870 Views · 2 Likes

Design Principles-Building a Secure Cloud Architecture

To ensure cloud security, adopt key principles like least privilege, fail-safe design, and a zero-trust model for creating a robust and adaptive cloud architecture.

March 19, 2024

by Suhas Jangoan

· 11,998 Views · 3 Likes

98% GPU Utilization Achieved in 1K GPU-Scale AI Training Using Distributed Cache

In this article, learn how JuiceFS achieved over 98% GPU utilization in 1,000 GPU-scale AI training using distributed cache.

March 19, 2024

by Edric Mo

· 1,818 Views · 1 Like

The Latest Data Engineering Topics