Data Engineering Resources

GBase 8a Implementation Guide: Resource Assessment

The storage space requirements for a GBase cluster are calculated based on the data volume, the choice of compression algorithm, and the number of cluster replicas.

July 1, 2024

by Cong Li

· 4,341 Views · 1 Like

A Look Into Netflix System Architecture

Netflix Architecture is designed to efficiently and reliably provide content to millions of consumers at once. Here's a breakdown of its characteristics and components.

July 1, 2024

by Rahul Shivalkar

· 12,348 Views · 8 Likes

High Availability and Disaster Recovery (HADR) in SQL Server on AWS

We will guide you through the process of configuring HADR for SQL Server on AWS, providing practical code examples for setting up and recovering a SQL Server database.

July 1, 2024

by Vijay Panwar

CORE

· 3,785 Views · 1 Like

Terraform Tips for Efficient Infrastructure Management

Securely manage your state files, use reusable modules, organize your code, and integrate automation to elevate your Terraform infrastructure management.

July 1, 2024

by Mariusz Michalowski

· 4,746 Views · 1 Like

Handling “Element Is Not Clickable at Point” Exception in Selenium

Struggling with "element is not clickable at point" in Selenium? Learn why this exception occurs and fix it with effective solutions for smooth test automation.

July 1, 2024

by Faisal Khatri

· 3,207 Views · 1 Like

Use AWS Generative AI CDK Constructs To Speed up App Development

In this blog, we will use the AWS Generative AI Constructs Library to deploy a complete RAG application using multiple components.

July 1, 2024

by Abhishek Gupta

CORE

· 5,999 Views · 1 Like

Explainable AI: Seven Tools and Techniques for Model Interpretability

Struggling to understand complex AI models? This blog dives into seven powerful XAI tools like LIME, SHAP, and Integrated Gradients. Perfect for software developers!

July 1, 2024

by Sameer Danave

· 4,686 Views · 2 Likes

Implementing Real-Time Credit Card Fraud Detection With Apache Flink on AWS

Real-time fraud detection systems are essential for identifying and preventing fraudulent transactions as they occur. Apache Flink is useful in this scenario.

July 1, 2024

by Harsh Daiya

CORE

· 6,921 Views · 3 Likes

PostgreSQL BiDirectional Replication

Previously we ran Debezium in Embedded mode. In this blog, we shall focus on replication and, more specifically, bidirectional replication.

June 28, 2024

by Emmanouil Gkatziouras

CORE

· 10,309 Views · 3 Likes

Leveraging Microsoft Graph API for Unified Data Access and Insights

This article explores the capabilities of Microsoft Graph API and how it can be utilized to unify data access and gain insights.

June 28, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 10,445 Views · 2 Likes

AWS CDK: Infrastructure as Abstract Data Types

Begin a series examining CDK as a high-level object-oriented abstraction, defining cloud infrastructure by leveraging the power of programming languages.

June 28, 2024

by Nicolas Duminil

CORE

· 6,991 Views · 3 Likes

Pure Storage Accelerates Application Modernization With Robust Kubernetes and Cloud-Native Solutions

Empowering developers and IT teams to modernize applications with seamless Kubernetes integration, advanced data services, and flexible consumption models.

June 28, 2024

by Tom Smith

CORE

· 11,565 Views · 1 Like

Partitioning Hot and Cold Data Tier in Apache Kafka Cluster for Optimal Performance

Discover how by partitioning the hot and cold data tiers in the Apache Kafka Cluster, we can optimize storage resources based on data characteristics.

June 28, 2024

by Gautam Goswami

CORE

· 8,811 Views · 4 Likes

Spring AI: How To Write GenAI Applications With Java

In this article, take a look at how to write GenAI applications with Java using the Spring AI framework and utilize RAG for improving answers.

June 28, 2024

by Jennifer Reif

CORE

· 8,378 Views · 4 Likes

Node.js Walkthrough: Build a Simple Event-Driven Application With Kafka

Build a real-time event-driven app with Node.js and Kafka on Heroku. Follow this step-by-step guide to set up, deploy, and manage your application efficiently.

June 27, 2024

by Alvin Lee

CORE

· 14,858 Views · 3 Likes

On-Demand-Schedulers With MuleSoft CloudHub APIs

In this article, learn how to use MuleSoft's CloudHub APIs to run schedulers of an application on demand as well as how to access payload in HTML.

June 27, 2024

by Anupam Nath

· 2,877 Views · 1 Like

Data Governance: Data Integration (Part 4)

It's important to have a strong data governance framework in place when integrating data from different source systems. Learn more!

June 27, 2024

by Sukanya Konatam

· 11,995 Views · 1 Like

LLM Orchestrator: The Symphony of AI Services

Explore how software evolved from monolithic structures to AI's LLM Orchestrator, boosting enterprise efficiency and decision-making.

June 27, 2024

by Navveen Balani

· 3,148 Views · 2 Likes

Hammerspace Empowers GPU Computing With Enhanced S3 Data Orchestration

Hammerspace adds S3 support to its Global Data Platform, enabling automated orchestration of object data to GPU resources alongside file data.

June 27, 2024

by Tom Smith

CORE

· 6,803 Views · 1 Like

Mastering System Design: A Comprehensive Guide to System Scaling for Millions, Part 2

Distributed caching improves performance and scalability. This article explores strategies like sharding, horizontal scaling, and various caching policies.

June 27, 2024

by Alireza Rahmani Khalili

CORE

· 7,108 Views · 5 Likes

The Latest Data Engineering Topics