Data Engineering Resources

Memphis.dev Cloud Performance and Load Testing

This article presents the most recent Memphis.dev Cloud, multi-region benchmark tests, explores how to carry out performance testing, and provides recent benchmark data.

January 24, 2024

by Shay Bratslavsky

· 2,251 Views · 1 Like

A Revolutionary Cold Storage Solution for the Data Era

Glass-ceramic storage solution offers virtually unlimited media lifespan for affordable long-term data retention that drives scientific and medical research discoveries.

January 24, 2024

by Tom Smith

CORE

· 1,878 Views · 1 Like

Mobile Test Automation: Calabash on Xamarin Test-Cloud

A lot has been changed since this article was drafted, but the tooling and the use of cloud services are still very important and can still be used the same way.

January 24, 2024

by MESUT GUNES

· 1,843 Views · 1 Like

Instant App Backends With API and Logic Automation

See how API Automation unblocks client app dev with instant APIs. Logic automation reduces client code and promotes sharing with unique spreadsheet-like rules.

January 24, 2024

by Val Huber

CORE

· 2,264 Views · 6 Likes

How Much Is One Terabyte of Data?

Assuming each record takes up 100 bytes or 0.1 KB, one terabyte of storage can hold up to ten billion records.

January 24, 2024

by Judy Liu

· 1,506 Views · 2 Likes

AWS Migration Guide: 10 Frequently Asked Questions Answered

Explore key facets of shifting Windows workloads to AWS in this blog. Covering licensing, cost efficiency, automation, and end-of-support, unlock success in migration.

January 24, 2024

by Chiragsinh Vaghela

· 2,224 Views · 2 Likes

Storage Types Used on Cloud Computing Platforms

In this detailed post, we will look at the various storage formats that are often utilized in cloud computing systems.

January 24, 2024

by Aditya Bhuyan

· 2,361 Views · 2 Likes

Unlocking Advanced AWS Cost Optimization With Trusted Advisor

By implementing advanced strategies like resource right-sizing, reserved instances, automation, and continuous cost reviews, you can achieve even greater AWS savings.

January 24, 2024

by Raghava Dittakavi

CORE

· 12,128 Views · 3 Likes

Building a Generative AI Processor in Python

Why not create a Python Processor for Apache NiFi 2.0.0? In this tutorial, discover whether the challenge to do so is easy or difficult.

January 23, 2024

by Tim Spann

CORE

· 3,571 Views · 5 Likes

Big Data Realtime Data Pipeline Architecture

In this article, let's explore the key components of a Big data Realtime data pipeline and architecture.

January 23, 2024

by Amrish Solanki

· 4,453 Views · 5 Likes

Integrating Rate-Limiting and Backpressure Strategies Synergistically To Handle and Alleviate Consumer Lag in Apache Kafka

Kafka Consumer Lag refers to the variance between the most recent message within a Kafka topic and the message that has been processed by a consumer. This lag may arise when the consumer struggles to match the pace at which new messages are generated and appended to the topic.

January 23, 2024

by Gautam Goswami

CORE

· 2,491 Views · 2 Likes

Debezium in Embedded Mode

In this tutorial, learn how to run Debezium through a Java application without the need for a standalone Debezium server running or a streaming component.

January 23, 2024

by Emmanouil Gkatziouras

CORE

· 5,424 Views · 4 Likes

IntelliJ and Java Spring Microservices: Productivity Tips With GitHub Copilot

Explore productivity tips that can enhance your Java Spring Microservices development experience in IntelliJ, all made possible with the help of GitHub Copilot.

January 23, 2024

by Amol Gote

CORE

· 12,458 Views · 9 Likes

Making AI Real: How Groq Simplifies Machine Learning for Developers

Learn how AI enables real-time machine learning inference, speeds time-to-insight, reduces time-to-production and provides future-proof infrastructure for AI growth.

January 23, 2024

by Tom Smith

CORE

· 3,217 Views · 2 Likes

O11y Guide: Cloud-Native Observability Pitfalls, Introduction

The road to cloud-native success has many pitfalls and the more you know about them, the easier they are to tackle or avoid altogether. Learn more in this post.

January 23, 2024

by Eric D. Schabell

CORE

· 2,340 Views · 4 Likes

DevOps Nirvana: Mastering the Azure Pipeline To Unleash Agility

Discover agility with our guide: 'Mastering the Azure Pipeline.' Optimize development and deployment and elevate your workflows for efficient software delivery.

January 23, 2024

by joshitha N

· 3,794 Views · 3 Likes

Enhancing Churn Prediction With Ensemble Learning Techniques

Customer churn is a substantial threat to businesses, affecting revenue and strategic planning. Predictive analytics has transitioned to an indispensable element of business strategy.

January 23, 2024

by Salman Khan

· 26,616 Views · 28 Likes

Unlocking the Potential: Top Benefits of Amazon SageMaker for Machine Learning

Explore the extensive benefits of Amazon SageMaker in this comprehensive guide. Learn how it enhances AI capabilities and revolutionizes data-driven projects.

January 23, 2024

by Chiragsinh Vaghela

· 1,478 Views · 2 Likes

Building a Reference Architecture for a Demand-Side Platform in AdTech

Learn the key architectural components and explore a real-time bidding use case featuring Redpanda, Aerospike, and Flink.

January 23, 2024

by Dunith Dhanushka

CORE

· 1,607 Views · 1 Like

Fluent Bit: The Future of Logging in Kubernetes Environments

The article discusses Fluent Bit's role in Kubernetes environments, highlighting its lightweight architecture and efficient log processing capabilities.

January 23, 2024

by Rajesh Gheware

· 2,511 Views · 1 Like

The Latest Data Engineering Topics