Data Engineering Resources

Data Ingestion for Batch/Near Real-Time Analytics

This article provides an overview of the data ingestion process, utilizing a real-world example from the crypto industry.

November 21, 2023

by Keerthivasan santhanakrishnan

· 3,561 Views · 2 Likes

Real-Time Remediation Solutions in Device Management Using Azure IoT Hub

Embrace Azure IOT Hub into Windows services for Duplex communication and command execution. Building an MQTT Broker and scaling in the cloud is resource-heavy.

November 21, 2023

by Nagendran Sathananda Manidas

· 2,993 Views · 2 Likes

Fluent Interface Design Pattern in Automation Testing

This blog discusses the fluent interface design pattern and discusses writing Selenium web automation tests in a fluent way.

November 21, 2023

by Faisal Khatri

CORE

· 3,882 Views · 2 Likes

A Deep Dive Into Different Types of Caching in Presto

Understand the caching mechanisms for the popular distributed SQL engine and how to use them to improve query speed and efficiency.

November 21, 2023

by Hope Wang

· 2,032 Views · 3 Likes

How To Deploy Llama2 on AWS With Walrus in Minutes

In this blog, we will explore how to deploy Llama2 on AWS with Walrus. Walrus is an open-source application management platform.

November 21, 2023

by Ally Lynn

· 1,994 Views · 2 Likes

Power BI Dashboards: Your Guide to Data Analysis and Visualization

In this post, we will dive into the world of data visualization with Power BI dashboard examples. Let’s start with introducing a robust data visualization tool, Power BI.

November 21, 2023

by Adarsh Parikh

· 1,552 Views · 1 Like

JavaScript Naming Conventions Are Important

Learn JavaScript naming conventions for cleaner code: variables, functions, classes, and more. Enhance code readability and collaboration.

November 21, 2023

by Vladyslav Zubko

· 2,971 Views · 3 Likes

Azure Durable Functions: Fan-Out/Fan-In Pattern

This article discusses the “fan-out/fan-in” pattern — a technique used to parallelize and consolidate the execution of multiple tasks.

November 21, 2023

by Oriol Sr

· 3,861 Views · 1 Like

Amazon Web Services (AWS): Revolutionizing Cloud Computing and Transforming Businesses

This article delves into the world of AWS, exploring its evolution, key offerings, benefits, and its impact on businesses across industries.

November 21, 2023

by Aditya Bhuyan

· 2,601 Views · 2 Likes

Unveiling the Magic of AWS CloudFormation Templates

In the ever-evolving landscape of cloud computing, Infrastructure as Code (IaC) has become an essential tool for managing cloud resources efficiently.

November 21, 2023

by abhishek singh

· 3,328 Views · 1 Like

Be a Better Team Player

Many API developers are familiar with Postman. Though I use it extensively for solo dev work, we know what Postman brings to the table for team API development.

November 21, 2023

by Alvin Lee

CORE

· 4,885 Views · 3 Likes

A Guide to Prometheus Exporters: Techniques and Best Practices

In this article, we’ll take a look at the use of Prometheus exporters, some Prometheus exporter examples, and their use in action.

November 21, 2023

by Sara Miteva

CORE

· 3,939 Views · 2 Likes

Unveiling the Power of Six Sigma: Exploring the Process and Its Belts

In this article, we will delve into the Six Sigma process and explore the different belts that guide its implementation.

November 20, 2023

by Aditya Bhuyan

· 3,646 Views · 3 Likes

Exploring Slowly Changing Dimensions in Data Warehousing

This article provides a comprehensive overview of Slowly Changing Dimensions (SCDs) in data warehouses, examining various types and their practical implementations.

November 20, 2023

by Mandar Khoje

· 4,200 Views · 4 Likes

Big Data Empowers IoT: Challenges and Solutions

This article explores how Big Data tools address challenges in integrating IoT and offers solutions for various challenges.

November 20, 2023

by Deep Manishkumar Dave

· 3,546 Views · 3 Likes

Performance Optimization in ETL Processes

Explore ETL optimization strategies for enhanced data processing, cost efficiency, and business insights in this comprehensive guide.

November 20, 2023

by Paul Carnell

· 3,138 Views · 1 Like

Distributed Cloud Architecture for Resilient Systems: Rethink Your Approach To Resilient Cloud Services

Employing cloud services can incur a great deal of risk if not planned and designed correctly. Learn how to rethink your approach to resilient cloud services.

November 20, 2023

by John Vester

CORE

· 7,969 Views · 4 Likes

How To Understand and Choose Your First EC2 Instance on AWS

This article will help you understand what AWS EC2 instances are and then give you tips to follow when choosing your first instance.

November 20, 2023

by Usama Amin

· 3,869 Views · 1 Like

How To Deal With AWS’s Ban on Reserved Instances Resale

AWS is no longer allowing you to resell Reserved Instances starting January 15, 2024. Explore the solution to the new ban.

November 20, 2023

by Laurent Gil

· 2,827 Views · 3 Likes

Examining Use Cases for Asynchronous APIs: Webhooks and WebSockets

In an age where digital immediacy and real-time feedback dominate user expectations, asynchronous APIs stand out as a beacon for enhanced interactivity and efficiency.

November 20, 2023

by Ian Douglas

· 2,928 Views · 2 Likes

The Latest Data Engineering Topics