Data Engineering Resources

Apache Druid: A Hybrid Data Warehouse for Fast Analytics

Deep Dive into Druid’s architecture to understand sub-second query response and parallel batch and streaming ingestion.

January 25, 2024

by Anandaganesh Balakrishnan

· 3,499 Views · 3 Likes

Simplifying Data Management: How StorageX Uses AI To Help Developers

Learn how a smart data platform automates management, optimizes cloud data, scales limitlessly, and processes data ultra-efficiently by moving compute to data.

January 24, 2024

by Tom Smith

CORE

· 2,384 Views · 2 Likes

Getting Started With Spring AI and PostgreSQL PGVector

Learn to build generative AI applications in Java from scratch using Spring AI and PostgreSQL pgvector.

January 24, 2024

by Denis Magda

CORE

· 9,179 Views · 8 Likes

Could a Scrum GPT Challenge Scrum Masters?

This article answers if Scrum Masters change from essential practitioners to a niche role.

January 24, 2024

by Stefan Wolpers

CORE

· 2,270 Views · 1 Like

Agile Methodologies for Edge Computing in IoT

Agile methodologies enhance IoT edge computing, boosting efficiency, innovation, and speed in development and deployment processes.

January 24, 2024

by Deep Manishkumar Dave

· 3,049 Views · 2 Likes

AI/Machine Learning Techniques: The Cheat Sheet

This paper is a summary that breaks down the big ideas of machine learning into easy-to-understand parts. Think of it as a quick reference or a cheat sheet.

January 24, 2024

by Pier-Jean MALANDRINO

CORE

· 1,426 Views · 2 Likes

Ingesting Webhooks From Stripe, the Better Way

Learn what webhooks are, and how you use them with Stripe to react to events quickly and in real-time with greater reliability using a streaming platform.

January 24, 2024

by Shoham Roditi Elimelech

· 1,662 Views · 1 Like

Memphis.dev Cloud Performance and Load Testing

This article presents the most recent Memphis.dev Cloud, multi-region benchmark tests, explores how to carry out performance testing, and provides recent benchmark data.

January 24, 2024

by Shay Bratslavsky

· 2,261 Views · 1 Like

A Revolutionary Cold Storage Solution for the Data Era

Glass-ceramic storage solution offers virtually unlimited media lifespan for affordable long-term data retention that drives scientific and medical research discoveries.

January 24, 2024

by Tom Smith

CORE

· 1,887 Views · 1 Like

Mobile Test Automation: Calabash on Xamarin Test-Cloud

A lot has been changed since this article was drafted, but the tooling and the use of cloud services are still very important and can still be used the same way.

January 24, 2024

by MESUT GUNES

· 1,852 Views · 1 Like

Instant App Backends With API and Logic Automation

See how API Automation unblocks client app dev with instant APIs. Logic automation reduces client code and promotes sharing with unique spreadsheet-like rules.

January 24, 2024

by Val Huber

CORE

· 2,282 Views · 6 Likes

How Much Is One Terabyte of Data?

Assuming each record takes up 100 bytes or 0.1 KB, one terabyte of storage can hold up to ten billion records.

January 24, 2024

by Judy Liu

· 1,514 Views · 2 Likes

AWS Migration Guide: 10 Frequently Asked Questions Answered

Explore key facets of shifting Windows workloads to AWS in this blog. Covering licensing, cost efficiency, automation, and end-of-support, unlock success in migration.

January 24, 2024

by Chiragsinh Vaghela

· 2,234 Views · 2 Likes

Storage Types Used on Cloud Computing Platforms

In this detailed post, we will look at the various storage formats that are often utilized in cloud computing systems.

January 24, 2024

by Aditya Bhuyan

· 2,368 Views · 2 Likes

Unlocking Advanced AWS Cost Optimization With Trusted Advisor

By implementing advanced strategies like resource right-sizing, reserved instances, automation, and continuous cost reviews, you can achieve even greater AWS savings.

January 24, 2024

by Raghava Dittakavi

CORE

· 12,145 Views · 3 Likes

Building a Generative AI Processor in Python

Why not create a Python Processor for Apache NiFi 2.0.0? In this tutorial, discover whether the challenge to do so is easy or difficult.

January 23, 2024

by Tim Spann

CORE

· 3,598 Views · 5 Likes

Big Data Realtime Data Pipeline Architecture

In this article, let's explore the key components of a Big data Realtime data pipeline and architecture.

January 23, 2024

by Amrish Solanki

· 4,492 Views · 5 Likes

Integrating Rate-Limiting and Backpressure Strategies Synergistically To Handle and Alleviate Consumer Lag in Apache Kafka

Kafka Consumer Lag refers to the variance between the most recent message within a Kafka topic and the message that has been processed by a consumer. This lag may arise when the consumer struggles to match the pace at which new messages are generated and appended to the topic.

January 23, 2024

by Gautam Goswami

CORE

· 2,511 Views · 2 Likes

Debezium in Embedded Mode

In this tutorial, learn how to run Debezium through a Java application without the need for a standalone Debezium server running or a streaming component.

January 23, 2024

by Emmanouil Gkatziouras

CORE

· 5,486 Views · 4 Likes

IntelliJ and Java Spring Microservices: Productivity Tips With GitHub Copilot

Explore productivity tips that can enhance your Java Spring Microservices development experience in IntelliJ, all made possible with the help of GitHub Copilot.

January 23, 2024

by Amol Gote

CORE

· 12,495 Views · 9 Likes

The Latest Data Engineering Topics