Data Engineering Resources

Beyond Data Silos: Data Mesh, Game Changer for Enterprises

This article explains data mesh, a data architecture that gives more power and flexibility to data domains. It shows why data mesh is a good option for data management.

January 25, 2024

by Kshitiz Jain

· 2,549 Views · 3 Likes

Simplify Data Management With Rimage’s AI-Powered Platform

Automated lifecycle management, cost optimization, robust security, and seamless scalability empower developers and engineers to tame complex data environments.

January 25, 2024

by Tom Smith

CORE

· 2,745 Views · 1 Like

Apache Druid: A Hybrid Data Warehouse for Fast Analytics

Deep Dive into Druid’s architecture to understand sub-second query response and parallel batch and streaming ingestion.

January 25, 2024

by Anandaganesh Balakrishnan

· 4,925 Views · 3 Likes

Simplifying Data Management: How StorageX Uses AI To Help Developers

Learn how a smart data platform automates management, optimizes cloud data, scales limitlessly, and processes data ultra-efficiently by moving compute to data.

January 24, 2024

by Tom Smith

CORE

· 3,127 Views · 2 Likes

Getting Started With Spring AI and PostgreSQL PGVector

Learn to build generative AI applications in Java from scratch using Spring AI and PostgreSQL pgvector.

January 24, 2024

by Denis Magda

CORE

· 12,722 Views · 8 Likes

Could a Scrum GPT Challenge Scrum Masters?

This article answers if Scrum Masters change from essential practitioners to a niche role.

January 24, 2024

by Stefan Wolpers

CORE

· 2,773 Views · 1 Like

Agile Methodologies for Edge Computing in IoT

Agile methodologies enhance IoT edge computing, boosting efficiency, innovation, and speed in development and deployment processes.

January 24, 2024

by Deep Manishkumar Dave

· 4,271 Views · 2 Likes

AI/Machine Learning Techniques: The Cheat Sheet

This paper is a summary that breaks down the big ideas of machine learning into easy-to-understand parts. Think of it as a quick reference or a cheat sheet.

January 24, 2024

by Pier-Jean MALANDRINO

CORE

· 1,919 Views · 2 Likes

Ingesting Webhooks From Stripe, the Better Way

Learn what webhooks are, and how you use them with Stripe to react to events quickly and in real-time with greater reliability using a streaming platform.

January 24, 2024

by Shoham Roditi Elimelech

· 2,000 Views · 1 Like

Memphis.dev Cloud Performance and Load Testing

This article presents the most recent Memphis.dev Cloud, multi-region benchmark tests, explores how to carry out performance testing, and provides recent benchmark data.

January 24, 2024

by Shay Bratslavsky

· 2,778 Views · 1 Like

A Revolutionary Cold Storage Solution for the Data Era

Glass-ceramic storage solution offers virtually unlimited media lifespan for affordable long-term data retention that drives scientific and medical research discoveries.

January 24, 2024

by Tom Smith

CORE

· 2,480 Views · 1 Like

Mobile Test Automation: Calabash on Xamarin Test-Cloud

A lot has been changed since this article was drafted, but the tooling and the use of cloud services are still very important and can still be used the same way.

January 24, 2024

by MESUT GUNES

· 2,281 Views · 1 Like

Instant App Backends With API and Logic Automation

See how API Automation unblocks client app dev with instant APIs. Logic automation reduces client code and promotes sharing with unique spreadsheet-like rules.

January 24, 2024

by Val Huber

CORE

· 3,078 Views · 7 Likes

How Much Is One Terabyte of Data?

Assuming each record takes up 100 bytes or 0.1 KB, one terabyte of storage can hold up to ten billion records.

January 24, 2024

by Judy Liu

· 1,852 Views · 2 Likes

AWS Migration Guide: 10 Frequently Asked Questions Answered

Explore key facets of shifting Windows workloads to AWS in this blog. Covering licensing, cost efficiency, automation, and end-of-support, unlock success in migration.

January 24, 2024

by Chiragsinh Vaghela

· 2,813 Views · 2 Likes

Storage Types Used on Cloud Computing Platforms

In this detailed post, we will look at the various storage formats that are often utilized in cloud computing systems.

January 24, 2024

by Aditya Bhuyan

· 2,861 Views · 2 Likes

Unlocking Advanced AWS Cost Optimization With Trusted Advisor

By implementing advanced strategies like resource right-sizing, reserved instances, automation, and continuous cost reviews, you can achieve even greater AWS savings.

January 24, 2024

by Raghava Dittakavi

CORE

· 13,068 Views · 3 Likes

Building a Generative AI Processor in Python

Why not create a Python Processor for Apache NiFi 2.0.0? In this tutorial, discover whether the challenge to do so is easy or difficult.

January 23, 2024

by Tim Spann

CORE

· 5,090 Views · 5 Likes

Big Data Realtime Data Pipeline Architecture

In this article, let's explore the key components of a Big data Realtime data pipeline and architecture.

January 23, 2024

by Amrish Solanki

· 5,723 Views · 5 Likes

Integrating Rate-Limiting and Backpressure Strategies Synergistically To Handle and Alleviate Consumer Lag in Apache Kafka

Kafka Consumer Lag refers to the variance between the most recent message within a Kafka topic and the message that has been processed by a consumer. This lag may arise when the consumer struggles to match the pace at which new messages are generated and appended to the topic.

January 23, 2024

by Gautam Goswami

CORE

· 3,225 Views · 3 Likes

The Latest Data Engineering Topics