Data Engineering Resources

SOC 2 Audits as a Pillar of Data Accountability

SOC 2 audits are critical for cloud data security, ensuring companies meet standards for managing customer data with a focus on security, availability, and privacy.

March 20, 2024

by Suhas Jangoan

· 7,570 Views · 2 Likes

Graphs and Language

This comprehensive blog is a written transcription of Louis Guitton's talk at a recent conference, where he shared his insights around knowledge on Graph RAG and LLMs.

March 20, 2024

by Louis Guitton

· 2,222 Views · 1 Like

Introduction to KVM, SR-IOV, and Exploring the Advantages of SR-IOV in KVM Environments

KVM is a powerful virtualization technology integrated into the Linux kernel, allowing physical servers to host VMs efficiently.

March 20, 2024

by Prashanth Ravula

CORE

· 17,175 Views · 3 Likes

API Appliance for Extreme Agility and Simplicity

Use API Logic Server to create an API-based web app in minutes and add message-based integration, all with little knowledge of frameworks or Python.

March 20, 2024

by Val Huber

CORE

· 11,238 Views · 7 Likes

The Impact of Biometric Authentication on User Privacy and the Role of Blockchain in Preserving Secure Data

Blockchain technology is a novel solution to privacy concerns and risks associated with the storage and maintenance of biometric data.

March 20, 2024

by Saurav Bhattacharya

· 6,679 Views · 2 Likes

Design Principles-Building a Secure Cloud Architecture

To ensure cloud security, adopt key principles like least privilege, fail-safe design, and a zero-trust model for creating a robust and adaptive cloud architecture.

March 19, 2024

by Suhas Jangoan

· 11,909 Views · 3 Likes

98% GPU Utilization Achieved in 1K GPU-Scale AI Training Using Distributed Cache

In this article, learn how JuiceFS achieved over 98% GPU utilization in 1,000 GPU-scale AI training using distributed cache.

March 19, 2024

by Edric Mo

· 1,767 Views · 1 Like

10 Commandments of API-First Development

The article offers ten vital API guidelines, emphasizing design, security, and efficiency for business success.

March 19, 2024

by Vivin Nath

· 7,921 Views · 2 Likes

AWS Fargate: Deploy and Run Web API (.NET Core)

Explore this simple step-by-step guide to deploying a .NET Core Web API to AWS ECS Fargate serverless container service.

March 19, 2024

by Jawad Hasan Shani

CORE

· 20,069 Views · 1 Like

The Power of AI: Building a Robust Data Ecosystem for Enterprise Success

The article emphasizes the importance of building a comprehensive data ecosystem for enterprises, covering key principles, critical components, and value drivers for success.

March 19, 2024

by Siddharth Rajagopal

· 10,033 Views · 3 Likes

AI Revolution Journey With Qwen, RAG, and LangChain

This article provides an insightful exploration of the AI Revolution journey, delving into the concepts of Qwen, Retrieval-Augmented Generation (RAG), and LangChain.

March 19, 2024

by Farruh Kushnazarov

· 1,894 Views · 1 Like

Extracting Keywords From Text Using Natural Language Processing

With this article, I would like to help you broaden your understanding of NLP and show how spaCy can be your powerful ally in effective keyword extraction.

March 19, 2024

by Akshay Jain

· 47,889 Views · 104 Likes

ChatGPT Code Smell [Comic]

What is that smell? In this latest comic from Daniel Stori, discover the result of ChatGPT-generated code.

March 19, 2024

by Daniel Stori

CORE

· 4,425 Views · 2 Likes

Kafka Message Filtering: An Analysis

An analysis of how to implement a Kafka message filtering strategy, first as a general approach, then with the consumer needing to recover after deserialization errors.

March 19, 2024

by Horatiu Dan

CORE

· 4,390 Views · 6 Likes

Secure Your API With JWT: Kong OpenID Connect

In this article, walk through the issues of session-based authorization and the benefits of stateless tokens, namely JWT.

March 19, 2024

by Adam Zaręba

· 12,533 Views · 5 Likes

Harmonizing AI: Crafting Personalized Song Suggestions

Diving into machine learning, I developed "EmotiTuneOT," a system recommending songs based on users' emotions, using DeepLake and LangChain.

March 19, 2024

by Nacho Corcuera

· 3,128 Views · 1 Like

Exploring Zero-Trust Architecture Implementation in Modern Cybersecurity

Zero-trust flips conventional security on its head by shifting from an implicit trust model to one where verification is required every step of the way.

March 19, 2024

by Igboanugo David Ugochukwu

CORE

· 9,734 Views · 2 Likes

Breaking Down Data Silos With a Unified Data Warehouse: An Apache Doris-Based CDP

An insurance company uses Apache Doris in replacement of Spark+Impala+HBase+NebulaGraph, in their Customer Data Platform for 4 times faster customer grouping.

March 19, 2024

by Shirley H.

· 8,153 Views · 5 Likes

Using My New Raspberry Pi To Run an Existing GitHub Action

Experiment with self-hosted runner Raspberry Pi, using it to run an existing GitHub action. Read more about the author's findings!

March 18, 2024

by Nicolas Fränkel

· 8,099 Views · 2 Likes

Rethinking DevOps in 2024: Adapting to a New Era of Technology

Emerging technologies, evolving methodologies, and changing business needs are redefining what it means to implement DevOps practices effectively.

March 18, 2024

by Ankush Madaan

· 5,066 Views · 1 Like

The Latest Data Engineering Topics