Data Engineering Resources

Implement RAG Using Weaviate, LangChain4j, and LocalAI

In this blog, you will learn how to implement Retrieval Augmented Generation (RAG) using Weaviate, LangChain4j and LocalAI.

March 21, 2024

by Gunter Rotsaert

CORE

· 4,259 Views · 3 Likes

Data Processing in GCP With Apache Airflow and BigQuery

Efficient data processing is paramount. In this guide, we'll explore how to leverage Apache Airflow and BigQuery to create robust and scalable data pipelines.

March 20, 2024

by Sreenath Devineni

CORE

· 16,557 Views · 5 Likes

The Data Streaming Landscape 2024

This article presents a comparison of open-source Apache Kafka and Flink stream processing products, cloud, competition, and market trends.

March 20, 2024

by Kai Wähner

CORE

· 9,459 Views · 2 Likes

Securing Cloud Infrastructure: Leveraging Key Management Technologies

This article explores the world of secure key management, the intricacies of KMS and HSM, their benefits, use cases, key considerations, and best practices.

March 20, 2024

by Josephine Eskaline Joyce

CORE

· 10,209 Views · 4 Likes

API Governance: Ensuring Control and Compliance in the Era of Digital Transformation

This comprehensive article explores the significance of API governance, its key components, and best practices for implementation.

March 20, 2024

by Lakshmi Sushma Daggubati

· 9,142 Views · 1 Like

PostgresML: Streamlining AI Model Deployment With PostgreSQL Integration

By embracing PostgresML, organizations can tap into the power of AI-driven insights and gain a competitive edge in today's data-centric landscape.

March 20, 2024

by Pankaj Zanke

· 11,104 Views · 2 Likes

SOC 2 Audits as a Pillar of Data Accountability

SOC 2 audits are critical for cloud data security, ensuring companies meet standards for managing customer data with a focus on security, availability, and privacy.

March 20, 2024

by Suhas Jangoan

· 7,676 Views · 2 Likes

Graphs and Language

This comprehensive blog is a written transcription of Louis Guitton's talk at a recent conference, where he shared his insights around knowledge on Graph RAG and LLMs.

March 20, 2024

by Louis Guitton

· 2,311 Views · 1 Like

Introduction to KVM, SR-IOV, and Exploring the Advantages of SR-IOV in KVM Environments

KVM is a powerful virtualization technology integrated into the Linux kernel, allowing physical servers to host VMs efficiently.

March 20, 2024

by Prashanth Ravula

CORE

· 17,436 Views · 3 Likes

API Appliance for Extreme Agility and Simplicity

Use API Logic Server to create an API-based web app in minutes and add message-based integration, all with little knowledge of frameworks or Python.

March 20, 2024

by Val Huber

CORE

· 11,482 Views · 7 Likes

The Impact of Biometric Authentication on User Privacy and the Role of Blockchain in Preserving Secure Data

Blockchain technology is a novel solution to privacy concerns and risks associated with the storage and maintenance of biometric data.

March 20, 2024

by Saurav Bhattacharya

· 6,929 Views · 2 Likes

Design Principles-Building a Secure Cloud Architecture

To ensure cloud security, adopt key principles like least privilege, fail-safe design, and a zero-trust model for creating a robust and adaptive cloud architecture.

March 19, 2024

by Suhas Jangoan

· 12,048 Views · 3 Likes

98% GPU Utilization Achieved in 1K GPU-Scale AI Training Using Distributed Cache

In this article, learn how JuiceFS achieved over 98% GPU utilization in 1,000 GPU-scale AI training using distributed cache.

March 19, 2024

by Edric Mo

· 1,838 Views · 1 Like

10 Commandments of API-First Development

The article offers ten vital API guidelines, emphasizing design, security, and efficiency for business success.

March 19, 2024

by Vivin Nath

· 7,983 Views · 2 Likes

AWS Fargate: Deploy and Run Web API (.NET Core)

Explore this simple step-by-step guide to deploying a .NET Core Web API to AWS ECS Fargate serverless container service.

March 19, 2024

by Jawad Hasan Shani

CORE

· 20,195 Views · 1 Like

The Power of AI: Building a Robust Data Ecosystem for Enterprise Success

The article emphasizes the importance of building a comprehensive data ecosystem for enterprises, covering key principles, critical components, and value drivers for success.

March 19, 2024

by Siddharth Rajagopal

· 10,215 Views · 3 Likes

AI Revolution Journey With Qwen, RAG, and LangChain

This article provides an insightful exploration of the AI Revolution journey, delving into the concepts of Qwen, Retrieval-Augmented Generation (RAG), and LangChain.

March 19, 2024

by Farruh Kushnazarov

· 1,946 Views · 1 Like

Extracting Keywords From Text Using Natural Language Processing

With this article, I would like to help you broaden your understanding of NLP and show how spaCy can be your powerful ally in effective keyword extraction.

March 19, 2024

by Akshay Jain

· 48,036 Views · 104 Likes

ChatGPT Code Smell [Comic]

What is that smell? In this latest comic from Daniel Stori, discover the result of ChatGPT-generated code.

March 19, 2024

by Daniel Stori

CORE

· 4,707 Views · 2 Likes

Kafka Message Filtering: An Analysis

An analysis of how to implement a Kafka message filtering strategy, first as a general approach, then with the consumer needing to recover after deserialization errors.

March 19, 2024

by Horatiu Dan

CORE

· 4,517 Views · 6 Likes

The Latest Data Engineering Topics