Data Engineering Resources

Unlocking AES Encryption: A Deep Dive Into Its Inner Workings for Secure Data Protection

This article provides a comprehensive explanation of AES encryption, a robust method used to secure sensitive data. We delve into the intricate details of AES.

October 5, 2023

by Rupenkumar Anjaria

· 3,788 Views · 1 Like

Loading Streaming Data Into Cassandra Using Spark Structured Streaming

In this demo, learn how streaming data can be compatible with Cassandra and with Spark Structured Streaming as an intermediary.

October 5, 2023

by Patrick McFadin

· 2,239 Views · 1 Like

Modern MLOps Platform for Generative AI

A modern MLOps platform for Generative AI seamlessly integrates the practices of machine learning operations with the unique aspects of generative models.

October 5, 2023

by Navveen Balani

· 2,313 Views · 3 Likes

Building a Microservices API Gateway With YARP in ASP.NET Core Web API

Let's walk through a more detailed step-by-step process with code for a more comprehensive API Gateway using YARP in ASP.NET Core.

October 5, 2023

by Sardar Mudassar Ali Khan

· 7,286 Views · 1 Like

Gossip protocol facilitates efficient information propagation in social media networks, offering fault-tolerance, scalability, and quick updates using Python examples.

October 5, 2023

by Arun Pandey

CORE

· 10,563 Views · 5 Likes

Resizing Images On-The-Fly

In this post, we described how to use Apache APISIX with imgproxy to reduce the storage cost of images in multiple resolutions.

October 5, 2023

by Nicolas Fränkel

· 3,482 Views · 4 Likes

Evolution of Data Partitioning: Traditional vs. Modern Data Lakes

In this blog, we will be comparing data partitioning schemes in older data lakes to modern data lakes like Apache Iceberg.

October 5, 2023

by Karthik Penikalapati

· 5,163 Views · 6 Likes

Apache Kafka as Mission Critical Data Fabric for GenAI

Apache Kafka as real-time machine learning infrastructure for GenAI, chatbots, and large language models in mission-critical deployments.

October 5, 2023

by Kai Wähner

CORE

· 2,933 Views · 3 Likes

Revolutionizing Customer Engagement: Unleashing the Magic of Communication APIs

Communication APIs are facilitating rich, varied, and comprehensive channels for customer interaction, marking a new era of digital customer communication.

October 5, 2023

by Piyush Tripathi

· 2,598 Views · 1 Like

Deriving Organizational Value in the Age of AI

AI can improve an individual’s self-determination through greater competency, increased autonomy, and stronger relationships rather than feeling threatened by AI.

October 5, 2023

by Ashokkumar PrathabaReddy

· 3,741 Views · 2 Likes

Adapting API Strategies to Dynamic AI Trend

AI is getting a lot of attention these days. This article explores what the AI trend means for those of us developing products using APIs.

October 5, 2023

by Bobur Umurzokov

· 3,721 Views · 4 Likes

Exploring Apache Ignite With Spring Boot

Discuss distributed caching with Apache Ignite and Spring Boot, Ignite’s distributed locks, Spring Data support, and code-deployment to invoke remote code execution.

October 5, 2023

by Ion Pascari

· 11,799 Views · 5 Likes

10 of Our Favorite Actions for GitHub Actions

GitHub’s addition of Actions has seen its community build useful tasks that plug right into your repository. Here are 10 of our favorite GitHub Actions, plus how to install them.

October 4, 2023

by Andy Corrigan

· 3,357 Views · 3 Likes

5 Ways to Use Google Bard Effectively

Discover five strategies to maximize your productivity with Google Bard. Google Bard is reshaping workflows, enhancing decision-making, and driving success.

October 4, 2023

by Hiren Dhaduk

· 3,385 Views · 1 Like

Building Lambda Functions With Node.JS

Building Efficient Lambda Functions with Node.js: Unleashing the Power of Serverless Magic.

October 4, 2023

by pooja kumari

· 5,090 Views · 2 Likes

10 Ways To Optimize Your Azure Cost

This article provides Azure Cost optimization tips that help organizations to reduce Azure spending and various methods to keep track of the budget spent.

October 4, 2023

by Arun prabhu

· 2,759 Views · 1 Like

Build an AI Chat Bot for Your Data Using OPENAI, Pinecone, Airbyte and Langchain

Learn how to build a connector development support bot for Slack that knows all your APIs, open feature requests and previous Slack conversations by heart

October 4, 2023

by John Lafleur

· 2,905 Views · 1 Like

Firing Database Actions: A Guide To Using SQL Triggers With DbVisualizer

This tutorial introduces triggers, covers how they work, and provides guided examples for SQL code implementation in DbVisualizer.

October 4, 2023

by Ochuko Onojakpor

CORE

· 2,310 Views · 1 Like

Future-Proofing Data Architecture for Better Data Quality

In this article, explore best practices for building robust data engineering systems to deliver high-quality data.

October 4, 2023

by Xinran Waibel

· 5,366 Views · 2 Likes

The Complete Guide To Migrating to Amazon Aurora

This guide walks through the necessary steps for migrating your database to Amazon Aurora: planning the migration, executing it properly, and optimizing post-migration.

October 4, 2023

by Raghava Dittakavi

CORE

· 2,543 Views · 4 Likes

The Latest Data Engineering Topics