Data Engineering Resources

Terraform Tips for Efficient Infrastructure Management

Securely manage your state files, use reusable modules, organize your code, and integrate automation to elevate your Terraform infrastructure management.

July 1, 2024

by Mariusz Michalowski

· 4,939 Views · 2 Likes

Handling “Element Is Not Clickable at Point” Exception in Selenium

Struggling with "element is not clickable at point" in Selenium? Learn why this exception occurs and fix it with effective solutions for smooth test automation.

July 1, 2024

by Faisal Khatri

CORE

· 3,279 Views · 1 Like

Use AWS Generative AI CDK Constructs To Speed up App Development

In this blog, we will use the AWS Generative AI Constructs Library to deploy a complete RAG application using multiple components.

July 1, 2024

by Abhishek Gupta

CORE

· 6,102 Views · 1 Like

Explainable AI: Seven Tools and Techniques for Model Interpretability

Struggling to understand complex AI models? This blog dives into seven powerful XAI tools like LIME, SHAP, and Integrated Gradients. Perfect for software developers!

July 1, 2024

by Sameer Danave

· 5,134 Views · 2 Likes

Implementing Real-Time Credit Card Fraud Detection With Apache Flink on AWS

Real-time fraud detection systems are essential for identifying and preventing fraudulent transactions as they occur. Apache Flink is useful in this scenario.

July 1, 2024

by Harsh Daiya

CORE

· 7,065 Views · 4 Likes

PostgreSQL BiDirectional Replication

Previously we ran Debezium in Embedded mode. In this blog, we shall focus on replication and, more specifically, bidirectional replication.

June 28, 2024

by Emmanouil Gkatziouras

CORE

· 10,453 Views · 3 Likes

Leveraging Microsoft Graph API for Unified Data Access and Insights

This article explores the capabilities of Microsoft Graph API and how it can be utilized to unify data access and gain insights.

June 28, 2024

by Naga Santhosh Reddy Vootukuri

CORE

· 10,655 Views · 2 Likes

AWS CDK: Infrastructure as Abstract Data Types

Begin a series examining CDK as a high-level object-oriented abstraction, defining cloud infrastructure by leveraging the power of programming languages.

June 28, 2024

by Nicolas Duminil

CORE

· 7,171 Views · 4 Likes

Pure Storage Accelerates Application Modernization With Robust Kubernetes and Cloud-Native Solutions

Empowering developers and IT teams to modernize applications with seamless Kubernetes integration, advanced data services, and flexible consumption models.

June 28, 2024

by Tom Smith

CORE

· 11,665 Views · 2 Likes

Partitioning Hot and Cold Data Tier in Apache Kafka Cluster for Optimal Performance

Discover how by partitioning the hot and cold data tiers in the Apache Kafka Cluster, we can optimize storage resources based on data characteristics.

June 28, 2024

by Gautam Goswami

CORE

· 9,207 Views · 5 Likes

Spring AI: How To Write GenAI Applications With Java

In this article, take a look at how to write GenAI applications with Java using the Spring AI framework and utilize RAG for improving answers.

June 28, 2024

by Jennifer Reif

CORE

· 8,686 Views · 5 Likes

Node.js Walkthrough: Build a Simple Event-Driven Application With Kafka

Build a real-time event-driven app with Node.js and Kafka on Heroku. Follow this step-by-step guide to set up, deploy, and manage your application efficiently.

June 27, 2024

by Alvin Lee

CORE

· 15,233 Views · 3 Likes

On-Demand-Schedulers With MuleSoft CloudHub APIs

In this article, learn how to use MuleSoft's CloudHub APIs to run schedulers of an application on demand as well as how to access payload in HTML.

June 27, 2024

by Anupam Nath

· 3,030 Views · 1 Like

Data Governance: Data Integration (Part 4)

It's important to have a strong data governance framework in place when integrating data from different source systems. Learn more!

June 27, 2024

by Sukanya Konatam

· 12,215 Views · 1 Like

LLM Orchestrator: The Symphony of AI Services

Explore how software evolved from monolithic structures to AI's LLM Orchestrator, boosting enterprise efficiency and decision-making.

June 27, 2024

by Navveen Balani

· 3,306 Views · 2 Likes

Hammerspace Empowers GPU Computing With Enhanced S3 Data Orchestration

Hammerspace adds S3 support to its Global Data Platform, enabling automated orchestration of object data to GPU resources alongside file data.

June 27, 2024

by Tom Smith

CORE

· 6,917 Views · 1 Like

Mastering System Design: A Comprehensive Guide to System Scaling for Millions, Part 2

Distributed caching improves performance and scalability. This article explores strategies like sharding, horizontal scaling, and various caching policies.

June 27, 2024

by Alireza Rahmani Khalili

CORE

· 7,348 Views · 5 Likes

The Role of AI in Low- and No-Code Development

AI's integration into low- and no-code development accelerates app creation by leveraging capabilities like automated code generation and intelligent assistants.

June 27, 2024

by Eric Goebelbecker

CORE

· 4,890 Views · 2 Likes

Building Kafka Producer With Spring Boot

In this article, I am going to show you how to build Message Publisher using Apache Kafka and Spring Boot. First, we will talk about what Apache Kafka is.

June 26, 2024

by Sai Krishna Reddy Chityala

· 6,927 Views · 3 Likes

Cluster Logging of Telecom 5G IOT Microservice Pods

Learn how Kibana visualizes data indexed in Elasticsearch log storage for vast 5G Telecom data volumes in the Kubernetes Cloud.

June 26, 2024

by BINU SUDHAKARAN PILLAI

· 14,934 Views · 2 Likes

The Latest Data Engineering Topics