Data Engineering Resources

Automating Data

This article talks about how DevOps framework can bring together solutions that can be used to automate Data engineering.

November 17, 2023

by Yashraj Behera

· 4,044 Views · 1 Like

Painless Protection for Cloud-Native Apps Across the Lifecycle

HYCU brings unified data protection to cloud-native apps with granular recovery for developers and engineers across 50+ services.

November 17, 2023

by Tom Smith

CORE

· 3,554 Views · 1 Like

The Zero Copy Principle With Apache Kafka

When doing computer processes, the zero-copy technique is employed to prevent the CPU from being used for data copying across memory regions.

November 17, 2023

by Gautam Goswami

CORE

· 3,864 Views · 1 Like

Create a Low-Code GPT AI App in Five Minutes

By combining AINIRO with OpenAI's GPTs, you can wrap your entire database in a CRUD app in five minutes, using AI to interact with your database.

November 17, 2023

by Thomas Hansen

CORE

· 3,097 Views · 2 Likes

Reading Table Metadata With Flight SQL

An introduction to Apache Flight SQL, the benefits of Flight SQL, and how to read table metadata with the Python Flight SQL Client to explore your data.

November 16, 2023

by Anais Dotis-Georgiou

· 3,980 Views · 1 Like

Running Kafka in Kubernetes With Kraft Mode and SASL Authentication

Learn how to launch an Apache Kafka with the Apache Kafka Raft (KRaft) consensus protocol and SASL/PLAIN authentication.

November 16, 2023

by Rafael Natali

· 6,216 Views · 3 Likes

Ensuring API Resilience in Spring Microservices Using Retry and Fallback Mechanisms

Implement retry mechanisms and fallback methods in Spring microservices to handle API failures, ensuring enhanced reliability and improved user experience.

November 16, 2023

by Amol Gote

CORE

· 9,268 Views · 6 Likes

Architecture Approach: Domain-Driven Design (DDD)

Domain-Driven Design: A deep dive into aligning complex software with business needs through strategic modeling and continuous refinement.

November 16, 2023

by Pier-Jean MALANDRINO

CORE

· 3,852 Views · 2 Likes

Spring OAuth Server: Token Claim Customization

Learn how to use Spring Authorization Server to customize/add new claims in tokens for code flow response using customizer for JWT token.

November 16, 2023

by Naveen Maanju

· 7,588 Views · 2 Likes

Graph RAG: Unleashing the Power of Knowledge Graphs With LLM

This article introduces what Graph RAG is and how it enhances knowledge graphs in conjunction with LLMs to provide a more comprehensive contextual understanding.

November 16, 2023

by Wey Gu

· 4,831 Views · 2 Likes

Optimizing Generative AI With Retrieval-Augmented Generation: Architecture, Algorithms, and Applications Overview

This article targets AI professionals and focuses on examining the architecture, training, and applications of AI.

November 16, 2023

by Suresh Rajasekaran

· 6,923 Views · 3 Likes

Should Machines Use GenAI to Converse With Each Other in English?

Would teaching our machines to converse in English solve still-perplexing challenges of application and data integration?

November 16, 2023

by Jason Bloomberg

· 2,315 Views · 2 Likes

Build ChatGPT 2.0 With React JS

In this blog, we will explore how to build ChatGPT 2.0 with React JS, a powerful combination that can take your chatbot development to the next level.

November 16, 2023

by Atul Naithani

· 4,610 Views · 2 Likes

Top 30+ Microservices Interview Questions With Answers

In this article, we'll cover common Microservices interview questions with detailed answers to aid your interview preparation.

November 16, 2023

by Gyan Mishra

· 5,425 Views · 2 Likes

Data Analysis for Live Streaming: What Happens in Real Time Is Analyzed in Real Time?

This post is about how a live streaming service provider with 800 million end users found the right database to support its analytic solution.

November 16, 2023

by Shirley H.

· 2,532 Views · 2 Likes

Exploring Google Cloud Platform: A Comprehensive Overview of Services and Capabilities

In this article, we will delve into the various services offered by GCP and highlight their significance in the cloud computing landscape.

November 16, 2023

by Aditya Bhuyan

· 2,674 Views · 3 Likes

Modernizing SCADA Systems and OT/IT Integration With Apache Kafka

Explore the modernization of SCADA Systems and hybrid cloud OT/IT infrastructure with data streaming powered by Apache Kafka.

November 16, 2023

by Kai Wähner

CORE

· 4,183 Views · 4 Likes

Architecture Patterns: API Gateway

An API Gateway optimizes client-service interactions and enhances security, but needs careful design to avoid potential pitfalls. Proper use ensures scalability.

November 15, 2023

by Pier-Jean MALANDRINO

CORE

· 5,277 Views · 4 Likes

Exploring the Powerhouse of Cloud Computing: An In-Depth Look at Amazon Web Services (AWS)

This article aims to delve deeper into the core concepts and components of AWS, highlighting its key features, benefits, and the reasons behind its popularity.

November 15, 2023

by Aditya Bhuyan

· 4,633 Views · 3 Likes

Performance of ULID and UUID in Postgres Database

Don't know what data type to use for the primary key in Postgres? Let's take measurements for UUID and ULID and decide which is better.

November 15, 2023

by Artem Artemev

· 27,510 Views · 10 Likes

The Latest Data Engineering Topics