Data Engineering Resources

API Appliance for Extreme Agility and Simplicity

Use API Logic Server to create an API-based web app in minutes and add message-based integration, all with little knowledge of frameworks or Python.

March 20, 2024

by Val Huber

CORE

· 10,004 Views · 6 Likes

The Impact of Biometric Authentication on User Privacy and the Role of Blockchain in Preserving Secure Data

Blockchain technology is a novel solution to privacy concerns and risks associated with the storage and maintenance of biometric data.

March 20, 2024

by Saurav Bhattacharya

· 5,539 Views · 2 Likes

Design Principles-Building a Secure Cloud Architecture

To ensure cloud security, adopt key principles like least privilege, fail-safe design, and a zero-trust model for creating a robust and adaptive cloud architecture.

March 19, 2024

by Suhas Jangoan

· 10,749 Views · 3 Likes

98% GPU Utilization Achieved in 1K GPU-Scale AI Training Using Distributed Cache

In this article, learn how JuiceFS achieved over 98% GPU utilization in 1,000 GPU-scale AI training using distributed cache.

March 19, 2024

by Edric Mo

· 1,426 Views · 1 Like

10 Commandments of API-First Development

The article offers ten vital API guidelines, emphasizing design, security, and efficiency for business success.

March 19, 2024

by Vivin Nath

· 7,402 Views · 2 Likes

AWS Fargate: Deploy and Run Web API (.NET Core)

Explore this simple step-by-step guide to deploying a .NET Core Web API to AWS ECS Fargate serverless container service.

March 19, 2024

by Jawad Hasan Shani

CORE

· 18,788 Views · 1 Like

The Power of AI: Building a Robust Data Ecosystem for Enterprise Success

The article emphasizes the importance of building a comprehensive data ecosystem for enterprises, covering key principles, critical components, and value drivers for success.

March 19, 2024

by Siddharth Rajagopal

· 8,717 Views · 3 Likes

AI Revolution Journey With Qwen, RAG, and LangChain

This article provides an insightful exploration of the AI Revolution journey, delving into the concepts of Qwen, Retrieval-Augmented Generation (RAG), and LangChain.

March 19, 2024

by Farruh Kushnazarov

· 1,481 Views · 1 Like

Extracting Keywords From Text Using Natural Language Processing

With this article, I would like to help you broaden your understanding of NLP and show how spaCy can be your powerful ally in effective keyword extraction.

March 19, 2024

by Akshay Jain

· 46,670 Views · 104 Likes

ChatGPT Code Smell [Comic]

What is that smell? In this latest comic from Daniel Stori, discover the result of ChatGPT-generated code.

March 19, 2024

by Daniel Stori

CORE

· 3,485 Views · 1 Like

Kafka Message Filtering: An Analysis

An analysis of how to implement a Kafka message filtering strategy, first as a general approach, then with the consumer needing to recover after deserialization errors.

March 19, 2024

by Horatiu Dan

· 3,648 Views · 1 Like

Secure Your API With JWT: Kong OpenID Connect

In this article, walk through the issues of session-based authorization and the benefits of stateless tokens, namely JWT.

March 19, 2024

by Adam Zaręba

· 9,800 Views · 4 Likes

Harmonizing AI: Crafting Personalized Song Suggestions

Diving into machine learning, I developed "EmotiTuneOT," a system recommending songs based on users' emotions, using DeepLake and LangChain.

March 19, 2024

by Nacho Corcuera

· 2,434 Views · 1 Like

Exploring Zero-Trust Architecture Implementation in Modern Cybersecurity

Zero-trust flips conventional security on its head by shifting from an implicit trust model to one where verification is required every step of the way.

March 19, 2024

by Igboanugo David Ugochukwu

· 8,341 Views · 2 Likes

Breaking Down Data Silos With a Unified Data Warehouse: An Apache Doris-Based CDP

An insurance company uses Apache Doris in replacement of Spark+Impala+HBase+NebulaGraph, in their Customer Data Platform for 4 times faster customer grouping.

March 19, 2024

by Shirley H.

· 7,453 Views · 2 Likes

Using My New Raspberry Pi To Run an Existing GitHub Action

Experiment with self-hosted runner Raspberry Pi, using it to run an existing GitHub action. Read more about the author's findings!

March 18, 2024

by Nicolas Fränkel

CORE

· 6,935 Views · 2 Likes

Rethinking DevOps in 2024: Adapting to a New Era of Technology

Emerging technologies, evolving methodologies, and changing business needs are redefining what it means to implement DevOps practices effectively.

March 18, 2024

by Ankush Madaan

· 4,607 Views · 1 Like

LangChain, Python, and Heroku

In this tutorial, learn how to build and deploy LLM-based applications with ease using LangChain, Python, and Heroku for streamlined development and deployment.

March 18, 2024

by Alvin Lee

CORE

· 3,867 Views · 3 Likes

Power BI: Transforming Banking Data

As a data architect or data engineer, you know how vital it is to fully understand the power of your data. This task holds even more gravity in the banking sector.

March 18, 2024

by Serter Solak

· 35,586 Views · 7 Likes

Integrating Snowflake With Trino

Trino simplifies accessing Snowflake, highlighting its versatility in providing robust data management and analytics solutions for modern enterprises.

March 18, 2024

by Artem Ervits

CORE

· 13,413 Views · 1 Like

The Latest Data Engineering Topics