Data Engineering Resources

How to Create — and Configure — Apache Kafka Consumers

Elevate your open-source Apache Kafka deployment by better understanding how Kafka consumers work. Use this guide to create and configure your consumers.

February 6, 2024

by Anil Inamdar

· 4,907 Views · 4 Likes

A Look at Intelligent Document Processing and E-Invoicing

Buzzwords such as intelligent document processing are ubiquitous in today's business world (B2B), but many people don't know what these terms mean.

February 6, 2024

by Constantin Kwiatkowski

· 2,415 Views · 2 Likes

Top 3 AI Tools to Supercharge Your Software Development

Whether you are a Java developer at a beginner level or an expert, you have a lot to tap into using AI-powered tools and enjoy a rewarding coding experience.

February 6, 2024

by Freny Choudhary

· 2,732 Views · 1 Like

Rate Limiting Strategies for Efficient Traffic Management

Rate limiting ensures equitable API access and prevents abuse using strategies like Fixed Window, Sliding Log, and Token Bucket.

February 6, 2024

by Dileep Kumar Pandiya

· 3,177 Views · 2 Likes

Algorithmic Storytelling: Transforming Technical Features into Narratives

In this post, I delve into the idea that storytelling can transform the way we understand and engage with complex tech like Kotlin and Qbeast.

February 6, 2024

by alina grebenkina

· 24,833 Views · 1 Like

Introduction to Grafana, Prometheus, and Zabbix

This article discusses three observability tools, demonstrates their integration, how to collect the metrics, and how to show them in the dashboard.

February 6, 2024

by Babul Bansal

· 10,295 Views · 1 Like

Far Memory Unleashed: What Is Far Memory?

In-memory databases, which offer super fast transaction processing capabilities for OLTP systems and key-value store DBs, are gaining popularity.

February 6, 2024

by Subhadip Kumar

· 2,990 Views · 1 Like

Are Your ELT Tools Ready for Medallion Data Architecture?

To effectively execute ELT in Medallion Data Architecture, it is important to comprehend the data integration capabilities.

February 6, 2024

by Rajat Pandey

· 5,472 Views · 2 Likes

Learning on the Fly: How Adaptive AI Transforms Industries

Enter adaptive AI, a groundbreaking technology that is revolutionizing the way we learn and enhancing our ability to adapt on the fly.

February 6, 2024

by Ethan Millar

· 2,364 Views · 1 Like

The Future of Rollouts: From Big Bang to Smart and Secure Approach to Web Application Deployments

This article proposes a new way of using AWS to roll out updates safely to targeted user groups, reducing risk and improving user experience.

February 6, 2024

by Vinod Kolla

· 3,360 Views · 2 Likes

Format a Text in Go Better Than FMT

There is one more text formatting utility/lib with all FMT features, and this library processes text faster, which, in some cases, could be important.

February 6, 2024

by Michael Ushakov

· 1,842 Views · 1 Like

Exploring the New Eclipse JNoSQL Version 1.1.0: A Dive Into Oracle NoSQL

Eclipse JNoSQL 1.1.0 simplifies Java's NoSQL database integration with Jakarta Data annotations and custom repositories for easier and more business-centric code.

February 6, 2024

by Otavio Santana

CORE

· 4,519 Views · 4 Likes

Fighting Climate Change One Line of Code at a Time

Observability platforms provide detailed insight into IT carbon footprints to help developers optimize emissions and empower green coding initiatives.

February 6, 2024

by Tom Smith

CORE

· 2,250 Views · 1 Like

Best Practices and Phases of Data Migration From Legacy SAP to SAP

Data migration plays a very important role in the success of upgrading the legacy SAP to S/4 HANA. 10 Best Practices for SAP S/4HANA Data Migration

February 6, 2024

by Jayapal Vummadi

· 3,623 Views · 3 Likes

Mastering Complex Stored Procedures in SQL Server: A Practical Guide

This article delves into the intricacies of writing complex stored procedure logic in SQL Server to enhance your database management skills.

February 6, 2024

by Vijay Panwar

CORE

· 9,080 Views · 1 Like

Top 5 Reasons Why Your Redis Instance Might Fail

Delve into common challenges affecting Redis instances. Discover the top 5 reasons for failures and explore strategies for ensuring consistent and optimal performance.

February 5, 2024

by Nick Gottlieb

· 2,201 Views · 1 Like

The Trusted Liquid Workforce

Onboarding software developers securely is a challenge for most global organizations interested in protecting their intellectual property.

February 5, 2024

by Laurent Balmelli, PhD

· 2,895 Views · 2 Likes

Requirements, Code, and Tests: How Venn Diagrams Can Explain It All

This article explains how requirements, code, and tests are interconnected, using Venn diagrams as a visual aid.

February 5, 2024

by Stelios Manioudakis

CORE

· 6,055 Views · 4 Likes

Building and Deploying a Chatbot With Google Cloud Run and Dialogflow

Learn to build and deploy a chatbot using Dialogflow and Google Cloud Run for dynamic, scalable user interactions.

February 5, 2024

by Ashok Gorantla

CORE

· 15,638 Views · 5 Likes

Unlocking the Power Duo: Kafka and ClickHouse for Lightning-Fast Data Processing

Explore integration strategies for Kafka and ClickHouse, focusing on various methodologies like Kafka Engine, Kafka Connect, DoubleCloud Transfer, and ClickPipes.

February 5, 2024

by Andrei Tserakhau

· 3,986 Views · 1 Like

The Latest Data Engineering Topics