Data Engineering Resources

Azure Durable Functions: Fan-Out/Fan-In Pattern

This article discusses the “fan-out/fan-in” pattern — a technique used to parallelize and consolidate the execution of multiple tasks.

November 21, 2023

by Oriol Sr

· 1,658 Views · 1 Like

Amazon Web Services (AWS): Revolutionizing Cloud Computing and Transforming Businesses

This article delves into the world of AWS, exploring its evolution, key offerings, benefits, and its impact on businesses across industries.

November 21, 2023

by Aditya Bhuyan

· 1,617 Views · 2 Likes

Unveiling the Magic of AWS CloudFormation Templates

In the ever-evolving landscape of cloud computing, Infrastructure as Code (IaC) has become an essential tool for managing cloud resources efficiently.

November 21, 2023

by abhishek singh

· 1,939 Views · 1 Like

Be a Better Team Player

Many API developers are familiar with Postman. Though I use it extensively for solo dev work, we know what Postman brings to the table for team API development.

November 21, 2023

by Alvin Lee

CORE

· 2,192 Views · 3 Likes

A Guide to Prometheus Exporters: Techniques and Best Practices

In this article, we’ll take a look at the use of Prometheus exporters, some Prometheus exporter examples, and their use in action.

November 21, 2023

by Sara Miteva

CORE

· 2,716 Views · 2 Likes

Unveiling the Power of Six Sigma: Exploring the Process and Its Belts

In this article, we will delve into the Six Sigma process and explore the different belts that guide its implementation.

November 20, 2023

by Aditya Bhuyan

· 2,706 Views · 3 Likes

Exploring Slowly Changing Dimensions in Data Warehousing

This article provides a comprehensive overview of Slowly Changing Dimensions (SCDs) in data warehouses, examining various types and their practical implementations.

November 20, 2023

by Mandar Khoje

· 2,006 Views · 3 Likes

Big Data Empowers IoT: Challenges and Solutions

This article explores how Big Data tools address challenges in integrating IoT and offers solutions for various challenges.

November 20, 2023

by Deep Manishkumar Dave

· 2,035 Views · 2 Likes

Performance Optimization in ETL Processes

Explore ETL optimization strategies for enhanced data processing, cost efficiency, and business insights in this comprehensive guide.

November 20, 2023

by Paul Carnell

· 1,872 Views · 1 Like

Distributed Cloud Architecture for Resilient Systems

Employing cloud services can incur a great deal of risk if not planned and designed correctly. Learn how to rethink your approach to resilient cloud services.

November 20, 2023

by John Vester

CORE

· 4,376 Views · 2 Likes

How To Understand and Choose Your First EC2 Instance on AWS

This article will help you understand what AWS EC2 instances are and then give you tips to follow when choosing your first instance.

November 20, 2023

by Usama Amin

· 2,256 Views · 1 Like

How To Deal With AWS’s Ban on Reserved Instances Resale

AWS is no longer allowing you to resell Reserved Instances starting January 15, 2024. Explore the solution to the new ban.

November 20, 2023

by Laurent Gil

· 2,074 Views · 3 Likes

Examining Use Cases for Asynchronous APIs: Webhooks and WebSockets

In an age where digital immediacy and real-time feedback dominate user expectations, asynchronous APIs stand out as a beacon for enhanced interactivity and efficiency.

November 20, 2023

by Ian Douglas

· 2,224 Views · 2 Likes

Quality at Source: Rethinking Best Practices in Data Engineering

Rethinking Best Practices in Data Engineering has become a strategic imperative for organizations seeking to harness actionable insights and drive competitive advantage.

November 20, 2023

by Arvind Bhardwaj

· 1,570 Views · 1 Like

Building Your Own AI Chatbot With React and ChatGPT API

In this blog, we will guide you through the process of building your own Artificial Intelligence (AI) chatbot using React and the ChatGPT API.

November 20, 2023

by Atul Naithani

· 3,105 Views · 2 Likes

The Most Valuable Code Is the Code You Should Not Write

Coding skills in traditional programming languages will become less relevant as AI takes over. I propose the no-coding interview.

November 20, 2023

by Jasper Sprengers

CORE

· 2,647 Views · 4 Likes

Extend Your GPTs With C#

This article demonstrates how to create a GPT using OpenAI and extend it with your own C# code using AINIRO.IO Magic Cloud.

November 20, 2023

by Thomas Hansen

CORE

· 1,844 Views · 2 Likes

From Hadoop to Cloud: Why and How to Decouple Storage and Compute in Big Data Platforms

In this article, learn the importance and feasibility of storage-compute decoupling and explore available market solutions.

November 20, 2023

by Rui Su

· 1,752 Views · 1 Like

Discover the Performance Gain With Retrieval Augmented Generation

The world of RAG systems can be uncertain in terms of performance gains. This article introduces a simple end-to-end baseline for evaluating a RAG System.

November 20, 2023

by Fangrui Liu

· 1,619 Views · 1 Like

Unveiling the Application Modernization Roadmap: A Swift and Secure Journey to the Cloud

Legacy systems, once robust and reliable, now pose challenges for organizations seeking agility, cost-efficiency, and access to advanced technologies.

November 17, 2023

by Kapil Rawal

· 4,963 Views · 2 Likes

The Latest Data Engineering Topics