Data Engineering Resources

Securing Kubernetes in Production With Wiz

Wiz simplifies Kubernetes security in production with real-time threat detection, compliance automation, and robust protection for cloud-native environments.

February 10, 2025

by Sai Sandeep Ogety

CORE

· 7,852 Views · 2 Likes

Explore Open WebUI: Your Offline AI Interface

Discussing Open WebUI, a self-hosted AI interface that runs entirely offline. Learn how to install, configure, and use it with inference engines like Ollama.

February 10, 2025

by Gunter Rotsaert

CORE

· 2,464 Views

Improving Cloud Infrastructure for Achieving AGI

Achieving AGI requires improved cloud infrastructure, including more computational power, better algorithms, real-time data handling, and energy efficiency.

February 10, 2025

by Bhala Ranganathan

CORE

· 3,859 Views · 4 Likes

Designing AI Multi-Agent Systems in Java

We will design an AI Multi Agent, using Fibry. Being backed by Actors, it allows us to take control the parallelism in great detail.

February 10, 2025

by Luca Venturi

· 7,804 Views · 2 Likes

SQL Dynamic Data Masking for Privacy and Compliance

SQL Server Dynamic Data Masking helps protect sensitive data by obscuring it from non-privileged users, ensuring compliance with GDPR, HIPAA, and PCI-DSS.

February 10, 2025

by Dorababu Nadella

· 4,869 Views · 1 Like

A Guide to Using Amazon Bedrock Prompts for LLM Integration

Easily integrate LLMs into your application, manage prompts effectively and leverage the latest in LLM application development with Amazon Bedrock.

February 7, 2025

by Adit Jamdar

· 8,551 Views

Relational DB Migration to S3 Data Lake Via AWS DMS, Part I

This article discusses the challenges faced during relational database migration to AWS using DMS, including source data, logging, and network bandwidth issues.

February 7, 2025

by Vijay Bhosale

· 5,243 Views · 3 Likes

A View on Understanding Non-Human Identities Governance

Rethinking the governance, lifecycles, and interdependencies of your machine identities is essential for eliminating secrets sprawl and reducing your attack surface.

February 7, 2025

by Dwayne McDaniel

· 4,574 Views · 6 Likes

Build an AI Browser Agent With LLMs, Playwright, Browser Use

A guide on how to build an AI browser agent using LLMs, Playwright, and Browser Use to automate web interactions, extract data, and navigate sites efficiently.

February 7, 2025

by Kailash Pathak

CORE

· 18,208 Views · 4 Likes

Control Your Services With OTEL, Jaeger, and Prometheus

In this article, we will combine OTEL, Jaeger, and Prometheus for faster, centralized observability and quick troubleshooting in distributed systems.

February 7, 2025

by Ilia Ivankin

· 5,065 Views · 3 Likes

Data Management With PostgreSQL Partitioning and pg_partman

PostgreSQL table partitioning divides large tables into smaller segments to boost query performance, simplify maintenance, and enable scalable data management.

February 7, 2025

by arvind toorpu

CORE

· 3,972 Views · 1 Like

Exploring Operator, OpenAI’s New AI Agent

OpenAI has introduced its new AI agent, Operator. See how it can streamline software testing, reduce manual effort, and enhance accuracy with automation.

February 6, 2025

by Kailash Pathak

CORE

· 5,345 Views · 3 Likes

Community Over Code Keynotes Stress Open Source's Vital Role

This year's Community Over Code keynotes highlighted a maturing open-source ecosystem tackling new challenges around security, regulation, and scalability.

February 6, 2025

by Brian Proffitt

· 3,475 Views · 5 Likes

Best Practices for Scaling Kafka-Based Workloads

Kafka is a famous technology with a lot of great features and capabilities. This article explains Kafka producer and consumer configurations best practices.

February 6, 2025

by Narendra Lakshmana gowda

· 5,853 Views · 1 Like

How to Maximize the Azure Cosmos DB Availability

In this article, we will learn how to improve the Azure Cosmos database availability on applications that have zero tolerance for downtime.

February 6, 2025

by Prem Kumar Mani

· 4,358 Views

Build a URL Shortener With Neon, Azure Serverless Functions

Know how to build a simple and production-ready URL shortener running on Azure with serverless API using tools like Neon, Azure serverless, and Node.js.

February 6, 2025

by Bobur Umurzokov

· 5,687 Views · 2 Likes

How Spring Boot Starters Integrate With Your Project

The article provides an overview of Spring Boot starters, which are pre-packaged sets of dependencies that simplify adding functionality to Spring Boot applications.

February 5, 2025

by Taras Ivashchuk

· 5,946 Views · 3 Likes

The Role of DQ Checks in Data Pipelines

Why are DQ checks critical for every data pipeline, and what are some of the different types of DQ alerts you can set up to enhance the reliability of your pipeline?

February 5, 2025

by Ajay Krishnan Prabhakaran

· 5,421 Views

Demystifying Sorting Assertions With AssertJ

Know the options for sorting assertions in AssertJ, including ascending/descending order, multiple attributes, null handling, and case-insensitive sorting.

February 5, 2025

by Arnošt Havelka

CORE

· 8,476 Views · 3 Likes

Detecting Patterns in Event Streams With FlinkCEP

Patterns play a big role in ESP as they help to spot important sequences or behaviors in data that keep flowing nonstop.

February 5, 2025

by Gautam Goswami

CORE

· 6,493 Views · 2 Likes

The Latest Data Engineering Topics