Data Engineering Resources

Partitioning Hot and Cold Data Tier in Apache Kafka Cluster for Optimal Performance

Discover how by partitioning the hot and cold data tiers in the Apache Kafka Cluster, we can optimize storage resources based on data characteristics.

June 28, 2024

by Gautam Goswami

CORE

· 8,909 Views · 5 Likes

Spring AI: How To Write GenAI Applications With Java

In this article, take a look at how to write GenAI applications with Java using the Spring AI framework and utilize RAG for improving answers.

June 28, 2024

by Jennifer Reif

CORE

· 8,471 Views · 5 Likes

Node.js Walkthrough: Build a Simple Event-Driven Application With Kafka

Build a real-time event-driven app with Node.js and Kafka on Heroku. Follow this step-by-step guide to set up, deploy, and manage your application efficiently.

June 27, 2024

by Alvin Lee

CORE

· 14,966 Views · 3 Likes

On-Demand-Schedulers With MuleSoft CloudHub APIs

In this article, learn how to use MuleSoft's CloudHub APIs to run schedulers of an application on demand as well as how to access payload in HTML.

June 27, 2024

by Anupam Nath

· 2,910 Views · 1 Like

Data Governance: Data Integration (Part 4)

It's important to have a strong data governance framework in place when integrating data from different source systems. Learn more!

June 27, 2024

by Sukanya Konatam

· 12,081 Views · 1 Like

LLM Orchestrator: The Symphony of AI Services

Explore how software evolved from monolithic structures to AI's LLM Orchestrator, boosting enterprise efficiency and decision-making.

June 27, 2024

by Navveen Balani

· 3,191 Views · 2 Likes

Hammerspace Empowers GPU Computing With Enhanced S3 Data Orchestration

Hammerspace adds S3 support to its Global Data Platform, enabling automated orchestration of object data to GPU resources alongside file data.

June 27, 2024

by Tom Smith

CORE

· 6,836 Views · 1 Like

Mastering System Design: A Comprehensive Guide to System Scaling for Millions, Part 2

Distributed caching improves performance and scalability. This article explores strategies like sharding, horizontal scaling, and various caching policies.

June 27, 2024

by Alireza Rahmani Khalili

CORE

· 7,177 Views · 5 Likes

The Role of AI in Low- and No-Code Development

AI's integration into low- and no-code development accelerates app creation by leveraging capabilities like automated code generation and intelligent assistants.

June 27, 2024

by Eric Goebelbecker

CORE

· 4,733 Views · 2 Likes

Building Kafka Producer With Spring Boot

In this article, I am going to show you how to build Message Publisher using Apache Kafka and Spring Boot. First, we will talk about what Apache Kafka is.

June 26, 2024

by Sai Krishna Reddy Chityala

· 6,110 Views · 2 Likes

Cluster Logging of Telecom 5G IOT Microservice Pods

Learn how Kibana visualizes data indexed in Elasticsearch log storage for vast 5G Telecom data volumes in the Kubernetes Cloud.

June 26, 2024

by BINU SUDHAKARAN PILLAI

· 14,865 Views · 2 Likes

Pure Storage Unveils Groundbreaking Innovations in AI, Automation, and Cyber Resilience at Accelerate 2024

Pure Storage announces next-gen storage automation, AI-powered management, and advanced cyber resilience solutions at Accelerate 2024 to make storage simpler.

June 26, 2024

by Tom Smith

CORE

· 9,282 Views · 1 Like

Documenting a Spring REST API Using Smart-doc

Documentation is essential. In this article, we will explore how to use Smart-doc to generate documentation for a Spring Boot REST API.

June 26, 2024

by sun yu

· 10,802 Views · 3 Likes

MySQL to GBase 8C Migration Guide

This article provides a quick guide for migrating application systems based on MySQL databases to GBase databases (GBase 8c).

June 26, 2024

by Cong Li

· 2,009 Views · 1 Like

Unleashing the Power of Redis for Vector Database Applications

Redis, an in-memory data store, efficiently handles high-dimensional vector data for machine learning, providing fast, scalable, and rich querying capabilities.

June 26, 2024

by Lalithkumar Prakashchand

· 20,502 Views · 2 Likes

What Is ELT?

Learn about ELT (Extract, Load, Transform), a modern data management approach that loads raw data into cloud systems for scalable, real-time transformation and analytics.

June 25, 2024

by Suhas Jangoan

· 8,055 Views · 2 Likes

Cypress Debugging Hacks: Tips and Tricks for Speedy Resolution

Debugging Cypress tests can help identify issues in test code and the application under test. Here, learn more about the Cypress debugger and other dev tools.

June 25, 2024

by Kailash Pathak

CORE

· 3,248 Views · 4 Likes

Data Processing vs. Process Management vs. AI?

Modern process management can help to build the bridge between data processing and Large Language Models (LLMs) in a data-driven business landscape.

June 25, 2024

by Ralph Soika

· 2,983 Views · 1 Like

Shingling for Similarity and Plagiarism Detection

This article introduces you to the concept of shingling, the basics of the shingling technique, Jaccard similarity, advanced techniques, and optimizations.

June 25, 2024

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 3,471 Views · 4 Likes

When Not To Use Apache Kafka (Lightboard Video)

When not to use Apache Kafka, do's and don't's; no matter if you use open source, Confluent, Amazon MSK, Event Hubs, Redpanda, Warpstream, et al.

June 25, 2024

by Kai Wähner

CORE

· 2,223 Views · 1 Like

The Latest Data Engineering Topics