Data Engineering Resources

Geo-Location Redirects With AWS CloudFront

This article explores how to set up geo-location-based redirection with AWS CloudFront and provides a comprehensive guide to using it effectively.

September 30, 2024

by Alexander Sharov

· 3,667 Views · 4 Likes

How to Improve RAG Quality by Storing Knowledge Graphs in Vector Databases

This tutorial provides an in-depth look at how to improve standard LLM and vector database RAG quality with knowledge graphs.

September 30, 2024

by Tim Spann

CORE

· 4,313 Views · 8 Likes

Transformers: Age of Attention

Explore this simple explanation of the Transformer model from the revolutionary paper "Attention is All You Need," the basis of models like BERT and GPT.

September 30, 2024

by Bhavdeep Sethi

· 32,891 Views · 2 Likes

Stream Processing in the Serverless World

Learn how real-time data processing enables businesses to gain actionable insights without the overhead of managing infrastructure.

September 30, 2024

by Rajesh Pandey

· 4,157 Views · 3 Likes

Using AI in Your IDE To Work With Open-Source Code Bases

In this article, learn how we can add enhancements to the langchaingo project with Amazon Q Developer support in VS Code.

September 28, 2024

by Abhishek Gupta

CORE

· 3,507 Views · 2 Likes

Leveraging IBM WatsonX Data With Milvus to Build an Intelligent Slack Bot for Knowledge Retrieval

This tutorial covers populating the database with IBM WatsonX Data or open-source Milvus and connecting the bot to Slack to answer queries in real-time.

September 27, 2024

by Pradeep Gopalgowda

· 4,060 Views · 4 Likes

Indexes Under the Hood

One of the most obvious improvements for databases is to use indexes. Let's see them in detail to understand how they work in PostgreSQL and what makes them useful.

September 27, 2024

by Adam Furmanek

CORE

· 4,519 Views · 8 Likes

Assigning Pods to Nodes Using Affinity Rules

Affinity and anti-affinity are Kubernetes features to help you manage the schedule of your applications. Explore two scenarios where to use these features.

September 27, 2024

by Rafael Natali

· 4,750 Views · 4 Likes

Is Spring AI Strong Enough for AI?

Explore Spring's capabilities within the AI domain, its potential integration with AI libraries, and its ability to effectively manage AI workflows.

September 27, 2024

by Reza Ganji

CORE

· 12,424 Views · 13 Likes

Low-Code AI Agent for Classifying User Support Tickets With OpenAI and Kumologica

This article discusses the design and implementation of an intelligent case classification scenario using an AI agent in Kumologica and the OpenAI platform.

September 27, 2024

by Pranav K

CORE

· 3,050 Views · 2 Likes

Advanced Strategies for Building Modern Data Pipelines

Modern data pipelines streamline the flow of data by making it faster and easier to collect and use them. Here is a better way to understand and create one.

September 26, 2024

by Fawaz Ghali, PhD

CORE

· 3,999 Views · 1 Like

Integrating Data Engineering Into Artificial Intelligence

Importance of tight coupling between data engineering and artificial intelligence for data engineers and data scientists and best practices.

September 26, 2024

by Akshay Agarwal

· 2,862 Views · 3 Likes

Java for AI

Explore how the Java programming language can be used for AI development, along with supporting libraries and tools.

September 26, 2024

by SURESH SRIRANGAM

· 20,596 Views · 11 Likes

Angular RxJS Unleashed: Supercharge Your App With Reactive Operators

Master RxJS operators in Angular to efficiently manage data streams, handle errors, and enhance reactive programming in your apps.

September 26, 2024

by Raju Dandigam

· 4,092 Views · 4 Likes

Using Flink, Kafka, and NiFi for Real-Time Airport Arrivals and Departures

Learn to build a streaming application using the best of NiFi, Kafka, and Flink for event-driven apps. OpenSky networks rest feeds provide all the data.

September 26, 2024

by Timothy Spann

· 3,782 Views · 5 Likes

Backpressure in Distributed Systems

Learn more about backpressure, a technique in distributed systems to prevent overload and cascading failures by controlling the flow of requests.

September 26, 2024

by Rajesh Pandey

· 4,449 Views · 2 Likes

Building a Zero Trust API With ASP.NET Core: A Developer’s Guide

Secure your ASP.NET Core API with a Zero Trust model by authenticating every request, enforcing least privilege, and continuously monitoring to protect against threats.

September 25, 2024

by Aneesh Gopalakrishnan

· 4,995 Views · 4 Likes

Concurrency Issues in SQL and Distributed Systems

What happens if the first transaction must be canceled later for any reason? How should this affect the other transaction? Read on to understand!

September 25, 2024

by Adam Furmanek

CORE

· 4,292 Views · 5 Likes

Automating Data Pipelines With Snowflake: Leveraging DBT and Airflow Orchestration Frameworks for ETL/ELT Processes

This article explores the automation of data pipelines using Snowflake, dbt, and Airflow, detailing best practices for efficient data processing and orchestration.

September 25, 2024

by Harshavardhan Yedla

· 3,977 Views · 2 Likes

Feature Engineering Transforming Predictive Models

Delve into the transformative power of feature engineering in applied machine learning, and learn how carefully crafted features can elevate your models.

September 25, 2024

by Sundeep Goud Katta

· 3,124 Views · 3 Likes

The Latest Data Engineering Topics