Data Engineering Resources

Instant App Backends With API and Logic Automation

See how API Automation unblocks client app dev with instant APIs. Logic automation reduces client code and promotes sharing with unique spreadsheet-like rules.

January 24, 2024

by Val Huber

CORE

· 3,200 Views · 7 Likes

How Much Is One Terabyte of Data?

Assuming each record takes up 100 bytes or 0.1 KB, one terabyte of storage can hold up to ten billion records.

January 24, 2024

by Judy Liu

· 1,887 Views · 2 Likes

AWS Migration Guide: 10 Frequently Asked Questions Answered

Explore key facets of shifting Windows workloads to AWS in this blog. Covering licensing, cost efficiency, automation, and end-of-support, unlock success in migration.

January 24, 2024

by Chiragsinh Vaghela

· 2,882 Views · 2 Likes

Storage Types Used on Cloud Computing Platforms

In this detailed post, we will look at the various storage formats that are often utilized in cloud computing systems.

January 24, 2024

by Aditya Bhuyan

· 2,919 Views · 2 Likes

Unlocking Advanced AWS Cost Optimization With Trusted Advisor

By implementing advanced strategies like resource right-sizing, reserved instances, automation, and continuous cost reviews, you can achieve even greater AWS savings.

January 24, 2024

by Raghava Dittakavi

CORE

· 13,147 Views · 3 Likes

Building a Generative AI Processor in Python

Why not create a Python Processor for Apache NiFi 2.0.0? In this tutorial, discover whether the challenge to do so is easy or difficult.

January 23, 2024

by Tim Spann

CORE

· 5,199 Views · 5 Likes

Big Data Realtime Data Pipeline Architecture

In this article, let's explore the key components of a Big data Realtime data pipeline and architecture.

January 23, 2024

by Amrish Solanki

· 5,837 Views · 5 Likes

Integrating Rate-Limiting and Backpressure Strategies Synergistically To Handle and Alleviate Consumer Lag in Apache Kafka

Kafka Consumer Lag refers to the variance between the most recent message within a Kafka topic and the message that has been processed by a consumer. This lag may arise when the consumer struggles to match the pace at which new messages are generated and appended to the topic.

January 23, 2024

by Gautam Goswami

CORE

· 3,313 Views · 3 Likes

Debezium in Embedded Mode

In this tutorial, learn how to run Debezium through a Java application without the need for a standalone Debezium server running or a streaming component.

January 23, 2024

by Emmanouil Gkatziouras

CORE

· 6,831 Views · 4 Likes

IntelliJ and Java Spring Microservices: Productivity Tips With GitHub Copilot

Explore productivity tips that can enhance your Java Spring Microservices development experience in IntelliJ, all made possible with the help of GitHub Copilot.

January 23, 2024

by Amol Gote

CORE

· 13,964 Views · 9 Likes

Making AI Real: How Groq Simplifies Machine Learning for Developers

Learn how AI enables real-time machine learning inference, speeds time-to-insight, reduces time-to-production and provides future-proof infrastructure for AI growth.

January 23, 2024

by Tom Smith

CORE

· 4,693 Views · 2 Likes

O11y Guide: Cloud-Native Observability Pitfalls, Introduction

The road to cloud-native success has many pitfalls and the more you know about them, the easier they are to tackle or avoid altogether. Learn more in this post.

January 23, 2024

by Eric D. Schabell

CORE

· 2,836 Views · 4 Likes

DevOps Nirvana: Mastering the Azure Pipeline To Unleash Agility

Discover agility with our guide: 'Mastering the Azure Pipeline.' Optimize development and deployment and elevate your workflows for efficient software delivery.

January 23, 2024

by joshitha N

· 5,170 Views · 4 Likes

Enhancing Churn Prediction With Ensemble Learning Techniques

Customer churn is a substantial threat to businesses, affecting revenue and strategic planning. Predictive analytics has transitioned to an indispensable element of business strategy.

January 23, 2024

by Salman Khan

CORE

· 27,712 Views · 28 Likes

Unlocking the Potential: Top Benefits of Amazon SageMaker for Machine Learning

Explore the extensive benefits of Amazon SageMaker in this comprehensive guide. Learn how it enhances AI capabilities and revolutionizes data-driven projects.

January 23, 2024

by Chiragsinh Vaghela

· 1,885 Views · 2 Likes

Building a Reference Architecture for a Demand-Side Platform in AdTech

Learn the key architectural components and explore a real-time bidding use case featuring Redpanda, Aerospike, and Flink.

January 23, 2024

by Dunith Dhanushka

CORE

· 2,323 Views · 1 Like

Fluent Bit: The Future of Logging in Kubernetes Environments

The article discusses Fluent Bit's role in Kubernetes environments, highlighting its lightweight architecture and efficient log processing capabilities.

January 23, 2024

by Rajesh Gheware

CORE

· 3,251 Views · 1 Like