Data Engineering Resources

Exploring Slowly Changing Dimensions in Data Warehousing

This article provides a comprehensive overview of Slowly Changing Dimensions (SCDs) in data warehouses, examining various types and their practical implementations.

November 20, 2023

by Mandar Khoje

· 2,948 Views · 4 Likes

Big Data Empowers IoT: Challenges and Solutions

This article explores how Big Data tools address challenges in integrating IoT and offers solutions for various challenges.

November 20, 2023

by Deep Manishkumar Dave

· 2,680 Views · 2 Likes

Performance Optimization in ETL Processes

Explore ETL optimization strategies for enhanced data processing, cost efficiency, and business insights in this comprehensive guide.

November 20, 2023

by Paul Carnell

· 2,284 Views · 1 Like

Distributed Cloud Architecture for Resilient Systems: Rethink Your Approach To Resilient Cloud Services

Employing cloud services can incur a great deal of risk if not planned and designed correctly. Learn how to rethink your approach to resilient cloud services.

November 20, 2023

by John Vester

CORE

· 6,731 Views · 4 Likes

How To Understand and Choose Your First EC2 Instance on AWS

This article will help you understand what AWS EC2 instances are and then give you tips to follow when choosing your first instance.

November 20, 2023

by Usama Amin

· 3,004 Views · 1 Like

How To Deal With AWS’s Ban on Reserved Instances Resale

AWS is no longer allowing you to resell Reserved Instances starting January 15, 2024. Explore the solution to the new ban.

November 20, 2023

by Laurent Gil

· 2,377 Views · 3 Likes

Examining Use Cases for Asynchronous APIs: Webhooks and WebSockets

In an age where digital immediacy and real-time feedback dominate user expectations, asynchronous APIs stand out as a beacon for enhanced interactivity and efficiency.

November 20, 2023

by Ian Douglas

· 2,570 Views · 2 Likes

Quality at Source: Rethinking Best Practices in Data Engineering

Rethinking Best Practices in Data Engineering has become a strategic imperative for organizations seeking to harness actionable insights and drive competitive advantage.

November 20, 2023

by Arvind Bhardwaj

· 1,841 Views · 2 Likes

Building Your Own AI Chatbot With React and ChatGPT API

In this blog, we will guide you through the process of building your own Artificial Intelligence (AI) chatbot using React and the ChatGPT API.

November 20, 2023

by Atul Naithani

· 8,683 Views · 3 Likes

The Most Valuable Code Is the Code You Should Not Write

Coding skills in traditional programming languages will become less relevant as AI takes over. I propose the no-coding interview.

November 20, 2023

by Jasper Sprengers

CORE

· 3,808 Views · 5 Likes

Extend Your GPTs With C#

This article demonstrates how to create a GPT using OpenAI and extend it with your own C# code using AINIRO.IO Magic Cloud.

November 20, 2023

by Thomas Hansen

CORE

· 2,247 Views · 2 Likes

From Hadoop to Cloud: Why and How to Decouple Storage and Compute in Big Data Platforms

In this article, learn the importance and feasibility of storage-compute decoupling and explore available market solutions.

November 20, 2023

by Rui Su

· 1,951 Views · 1 Like

Discover the Performance Gain With Retrieval Augmented Generation

The world of RAG systems can be uncertain in terms of performance gains. This article introduces a simple end-to-end baseline for evaluating a RAG System.

November 20, 2023

by Fangrui Liu

· 1,769 Views · 1 Like

Unveiling the Application Modernization Roadmap: A Swift and Secure Journey to the Cloud

Legacy systems, once robust and reliable, now pose challenges for organizations seeking agility, cost-efficiency, and access to advanced technologies.

November 17, 2023

by Kapil Rawal

· 5,395 Views · 2 Likes

Mastering Prompt Engineering In AI Language Models

By refining and optimizing the instructions given to these models, we can obtain more accurate and contextually relevant responses.

November 17, 2023

by Oriol Sr

· 2,659 Views · 1 Like

A Comprehensive Approach to Performance Monitoring and Observability: Enhancing APM With Observability Insights at Scale

Delve into core concepts of observability and monitoring and how the modern observability approach differs from/complements traditional monitoring practices.

November 17, 2023

by Sudip Sengupta

CORE

· 5,496 Views · 4 Likes

How to Handle Secrets in Helm

Learn step-by-step techniques and best practices to handle secrets in Helm charts safely and effectively. Level up your Helm deployments today!

November 17, 2023

by Tiexin Guo

· 5,031 Views · 1 Like

LinkedIn’s Feed Evolution: More Granular and Powerful Machine Learning, Humans Still in the Loop

Read about how a recent update to LinkedIn's feed and infrastructure connects the principle of being people-centric to technical terms and implementation.

November 17, 2023

by George Anadiotis

· 4,377 Views · 1 Like

The Moat for Enterprise AI Is RAG + Fine Tuning: Here’s Why

Generative AI is top of mind for nearly every CEO, but how it achieves enterprise readiness is up for debate. Here’s why RAG and fine tuning are the keys to its success.

November 17, 2023

by Lior Gavish

· 2,477 Views · 1 Like

5 Best Practices for Secure Payment Processing in Applications

Build a trustworthy payment system for your app by taking the right precautions: using MFA, following PCI DSS guidelines, integrating fraud detection tools, and more.

November 17, 2023

by Zac Amos

· 3,009 Views · 1 Like

The Latest Data Engineering Topics