Data Engineering Resources

Simplify Data Management With Rimage’s AI-Powered Platform

Automated lifecycle management, cost optimization, robust security, and seamless scalability empower developers and engineers to tame complex data environments.

January 25, 2024

by Tom Smith

CORE

· 2,359 Views · 1 Like

Apache Druid: A Hybrid Data Warehouse for Fast Analytics

Deep Dive into Druid’s architecture to understand sub-second query response and parallel batch and streaming ingestion.

January 25, 2024

by Anandaganesh Balakrishnan

· 4,070 Views · 3 Likes

Simplifying Data Management: How StorageX Uses AI To Help Developers

Learn how a smart data platform automates management, optimizes cloud data, scales limitlessly, and processes data ultra-efficiently by moving compute to data.

January 24, 2024

by Tom Smith

CORE

· 2,678 Views · 2 Likes

Getting Started With Spring AI and PostgreSQL PGVector

Learn to build generative AI applications in Java from scratch using Spring AI and PostgreSQL pgvector.

January 24, 2024

by Denis Magda

CORE

· 10,749 Views · 8 Likes

Could a Scrum GPT Challenge Scrum Masters?

This article answers if Scrum Masters change from essential practitioners to a niche role.

January 24, 2024

by Stefan Wolpers

CORE

· 2,538 Views · 1 Like

Agile Methodologies for Edge Computing in IoT

Agile methodologies enhance IoT edge computing, boosting efficiency, innovation, and speed in development and deployment processes.

January 24, 2024

by Deep Manishkumar Dave

· 3,503 Views · 2 Likes

AI/Machine Learning Techniques: The Cheat Sheet

This paper is a summary that breaks down the big ideas of machine learning into easy-to-understand parts. Think of it as a quick reference or a cheat sheet.

January 24, 2024

by Pier-Jean MALANDRINO

CORE

· 1,643 Views · 2 Likes

Ingesting Webhooks From Stripe, the Better Way

Learn what webhooks are, and how you use them with Stripe to react to events quickly and in real-time with greater reliability using a streaming platform.

January 24, 2024

by Shoham Roditi Elimelech

· 1,803 Views · 1 Like

Memphis.dev Cloud Performance and Load Testing

This article presents the most recent Memphis.dev Cloud, multi-region benchmark tests, explores how to carry out performance testing, and provides recent benchmark data.

January 24, 2024

by Shay Bratslavsky

· 2,472 Views · 1 Like

A Revolutionary Cold Storage Solution for the Data Era

Glass-ceramic storage solution offers virtually unlimited media lifespan for affordable long-term data retention that drives scientific and medical research discoveries.

January 24, 2024

by Tom Smith

CORE

· 2,121 Views · 1 Like

Mobile Test Automation: Calabash on Xamarin Test-Cloud

A lot has been changed since this article was drafted, but the tooling and the use of cloud services are still very important and can still be used the same way.

January 24, 2024

by MESUT GUNES

· 2,038 Views · 1 Like

Instant App Backends With API and Logic Automation

See how API Automation unblocks client app dev with instant APIs. Logic automation reduces client code and promotes sharing with unique spreadsheet-like rules.

January 24, 2024

by Val Huber

CORE

· 2,652 Views · 7 Likes

How Much Is One Terabyte of Data?

Assuming each record takes up 100 bytes or 0.1 KB, one terabyte of storage can hold up to ten billion records.

January 24, 2024

by Judy Liu

· 1,630 Views · 2 Likes

AWS Migration Guide: 10 Frequently Asked Questions Answered

Explore key facets of shifting Windows workloads to AWS in this blog. Covering licensing, cost efficiency, automation, and end-of-support, unlock success in migration.

January 24, 2024

by Chiragsinh Vaghela

· 2,521 Views · 2 Likes

Storage Types Used on Cloud Computing Platforms

In this detailed post, we will look at the various storage formats that are often utilized in cloud computing systems.

January 24, 2024

by Aditya Bhuyan

· 2,627 Views · 2 Likes

Unlocking Advanced AWS Cost Optimization With Trusted Advisor

By implementing advanced strategies like resource right-sizing, reserved instances, automation, and continuous cost reviews, you can achieve even greater AWS savings.

January 24, 2024

by Raghava Dittakavi

CORE

· 12,475 Views · 3 Likes

Building a Generative AI Processor in Python

Why not create a Python Processor for Apache NiFi 2.0.0? In this tutorial, discover whether the challenge to do so is easy or difficult.

January 23, 2024

by Tim Spann

CORE

· 4,198 Views · 5 Likes

Big Data Realtime Data Pipeline Architecture

In this article, let's explore the key components of a Big data Realtime data pipeline and architecture.

January 23, 2024

by Amrish Solanki

· 4,926 Views · 5 Likes

Integrating Rate-Limiting and Backpressure Strategies Synergistically To Handle and Alleviate Consumer Lag in Apache Kafka

Kafka Consumer Lag refers to the variance between the most recent message within a Kafka topic and the message that has been processed by a consumer. This lag may arise when the consumer struggles to match the pace at which new messages are generated and appended to the topic.

January 23, 2024

by Gautam Goswami

CORE

· 2,767 Views · 2 Likes

Debezium in Embedded Mode

In this tutorial, learn how to run Debezium through a Java application without the need for a standalone Debezium server running or a streaming component.

January 23, 2024

by Emmanouil Gkatziouras

CORE

· 6,158 Views · 4 Likes

The Latest Data Engineering Topics