Data Engineering Resources

Assigning Pods to Nodes Using Affinity Rules

Affinity and anti-affinity are Kubernetes features to help you manage the schedule of your applications. Explore two scenarios where to use these features.

September 27, 2024

by Rafael Natali

· 5,443 Views · 4 Likes

Is Spring AI Strong Enough for AI?

Explore Spring's capabilities within the AI domain, its potential integration with AI libraries, and its ability to effectively manage AI workflows.

September 27, 2024

by Reza Ganji

CORE

· 16,461 Views · 15 Likes

Low-Code AI Agent for Classifying User Support Tickets With OpenAI and Kumologica

This article discusses the design and implementation of an intelligent case classification scenario using an AI agent in Kumologica and the OpenAI platform.

September 27, 2024

by Pranav K

CORE

· 3,736 Views · 2 Likes

Advanced Strategies for Building Modern Data Pipelines

Modern data pipelines streamline the flow of data by making it faster and easier to collect and use them. Here is a better way to understand and create one.

September 26, 2024

by Fawaz Ghali, PhD

CORE

· 4,668 Views · 2 Likes

Integrating Data Engineering Into Artificial Intelligence

Importance of tight coupling between data engineering and artificial intelligence for data engineers and data scientists and best practices.

September 26, 2024

by Akshay Agarwal

· 3,738 Views · 3 Likes

Java for AI

Explore how the Java programming language can be used for AI development, along with supporting libraries and tools.

September 26, 2024

by SURESH SRIRANGAM

· 39,832 Views · 12 Likes

Angular RxJS Unleashed: Supercharge Your App With Reactive Operators

Master RxJS operators in Angular to efficiently manage data streams, handle errors, and enhance reactive programming in your apps.

September 26, 2024

by Raju Dandigam

· 5,546 Views · 4 Likes

Using Flink, Kafka, and NiFi for Real-Time Airport Arrivals and Departures

Learn to build a streaming application using the best of NiFi, Kafka, and Flink for event-driven apps. OpenSky networks rest feeds provide all the data.

September 26, 2024

by Timothy Spann

· 4,526 Views · 5 Likes

Backpressure in Distributed Systems

Learn more about backpressure, a technique in distributed systems to prevent overload and cascading failures by controlling the flow of requests.

September 26, 2024

by Rajesh Kumar Pandey

· 8,631 Views · 3 Likes

Building a Zero Trust API With ASP.NET Core: A Developer’s Guide

Secure your ASP.NET Core API with a Zero Trust model by authenticating every request, enforcing least privilege, and continuously monitoring to protect against threats.

September 25, 2024

by Aneesh Gopalakrishnan

· 6,177 Views · 4 Likes

Concurrency Issues in SQL and Distributed Systems

What happens if the first transaction must be canceled later for any reason? How should this affect the other transaction? Read on to understand!

September 25, 2024

by Adam Furmanek

CORE

· 5,276 Views · 6 Likes

Automating Data Pipelines With Snowflake: Leveraging DBT and Airflow Orchestration Frameworks for ETL/ELT Processes

This article explores the automation of data pipelines using Snowflake, dbt, and Airflow, detailing best practices for efficient data processing and orchestration.

September 25, 2024

by Harshavardhan Yedla

· 5,471 Views · 2 Likes

Feature Engineering Transforming Predictive Models

Delve into the transformative power of feature engineering in applied machine learning, and learn how carefully crafted features can elevate your models.

September 25, 2024

by Sundeep Goud Katta

· 4,083 Views · 3 Likes

Securing Your Azure Kubernetes Services Cluster

Learn about securing an Azure Kubernetes cluster with the principle of least privilege as a top priority integrated with Microsoft Entra and Kubernetes RBAC.

September 25, 2024

by Rafael Natali

· 5,036 Views · 2 Likes

Probabilistic Graphical Models: A Gentle Introduction

Explore this guide to probabilistic graphical models, which represent probability distributions and capture conditional independence structures using graphs.

September 25, 2024

by Salman Khan

CORE

· 30,667 Views · 49 Likes

The Future of Application Security: Empowering Developers in the AI Era

Explore the future of application security in the AI era. Learn how developers can integrate security into their workflow and leverage AI responsibly.

September 25, 2024

by Tom Smith

CORE

· 2,967 Views · 1 Like

How to Convert Files to Thumbnail Images in Java

This article explores the benefits of and solutions for programmatically generating thumbnail images for documents passing through our file processing systems.

September 25, 2024

by Brian O'Neill

CORE

· 7,083 Views · 3 Likes

Simplifying Multi-Cloud Observability With Open Source

As cloud workloads become increasingly sophisticated, adopting an open-source and vendor-agnostic approach is key to streamlining organizational operations.

September 25, 2024

by Siri Varma Vegiraju

CORE

· 19,767 Views · 2 Likes

Optimizing External Secrets Operator Traffic

Learn how to efficiently implement External Secrets Operator in your Kubernetes cluster to reap the benefits of External Secrets Management systems.

September 25, 2024

by Upasana Sharma

· 8,153 Views · 8 Likes

Oracle NoSQL Database: A Comprehensive Guide for Developers

In this guide to the Oracle NoSQL database, learn more about what it is, explore developer-friendly tools, how to get started, common challenges, and more.

September 24, 2024

by Otavio Santana

CORE

· 7,676 Views · 1 Like

The Latest Data Engineering Topics