Data Engineering Resources

SQL Dynamic Data Masking for Privacy and Compliance

SQL Server Dynamic Data Masking helps protect sensitive data by obscuring it from non-privileged users, ensuring compliance with GDPR, HIPAA, and PCI-DSS.

February 10, 2025

by Dorababu Nadella

· 2,083 Views · 1 Like

A Guide to Using Amazon Bedrock Prompts for LLM Integration

Easily integrate LLMs into your application, manage prompts effectively and leverage the latest in LLM application development with Amazon Bedrock.

February 7, 2025

by Adit Jamdar

· 4,554 Views

Relational DB Migration to S3 Data Lake Via AWS DMS, Part I

This article discusses the challenges faced during relational database migration to AWS using DMS, including source data, logging, and network bandwidth issues.

February 7, 2025

by Vijay Bhosale

· 3,255 Views · 1 Like

A View on Understanding Non-Human Identities Governance

Rethinking the governance, lifecycles, and interdependencies of your machine identities is essential for eliminating secrets sprawl and reducing your attack surface.

February 7, 2025

by Dwayne McDaniel

· 2,906 Views · 3 Likes

Build an AI Browser Agent With LLMs, Playwright, Browser Use

A guide on how to build an AI browser agent using LLMs, Playwright, and Browser Use to automate web interactions, extract data, and navigate sites efficiently.

February 7, 2025

by Kailash Pathak

CORE

· 3,106 Views · 2 Likes

Control Your Services With OTEL, Jaeger, and Prometheus

In this article, we will combine OTEL, Jaeger, and Prometheus for faster, centralized observability and quick troubleshooting in distributed systems.

February 7, 2025

by Ilia Ivankin

· 2,578 Views

Data Management With PostgreSQL Partitioning and pg_partman

PostgreSQL table partitioning divides large tables into smaller segments to boost query performance, simplify maintenance, and enable scalable data management.

February 7, 2025

by arvind toorpu

· 2,410 Views

Exploring Operator, OpenAI’s New AI Agent

OpenAI has introduced its new AI agent, Operator. See how it can streamline software testing, reduce manual effort, and enhance accuracy with automation.

February 6, 2025

by Kailash Pathak

CORE

· 3,335 Views · 2 Likes

Community Over Code Keynotes Stress Open Source's Vital Role

This year's Community Over Code keynotes highlighted a maturing open-source ecosystem tackling new challenges around security, regulation, and scalability.

February 6, 2025

by Brian Proffitt

· 2,406 Views · 3 Likes

Best Practices for Scaling Kafka-Based Workloads

Kafka is a famous technology with a lot of great features and capabilities. This article explains Kafka producer and consumer configurations best practices.

February 6, 2025

by Narendra Lakshmana gowda

· 2,796 Views

How to Maximize the Azure Cosmos DB Availability

In this article, we will learn how to improve the Azure Cosmos database availability on applications that have zero tolerance for downtime.

February 6, 2025

by Prem Kumar Mani

· 2,747 Views

Build a URL Shortener With Neon, Azure Serverless Functions

Know how to build a simple and production-ready URL shortener running on Azure with serverless API using tools like Neon, Azure serverless, and Node.js.

February 6, 2025

by Bobur Umurzokov

· 3,775 Views · 1 Like

How Spring Boot Starters Integrate With Your Project

The article provides an overview of Spring Boot starters, which are pre-packaged sets of dependencies that simplify adding functionality to Spring Boot applications.

February 5, 2025

by Taras Ivashchuk

· 3,852 Views · 2 Likes

The Role of DQ Checks in Data Pipelines

Why are DQ checks critical for every data pipeline, and what are some of the different types of DQ alerts you can set up to enhance the reliability of your pipeline?

February 5, 2025

by Ajay Krishnan Prabhakaran

· 3,587 Views

Demystifying Sorting Assertions With AssertJ

Know the options for sorting assertions in AssertJ, including ascending/descending order, multiple attributes, null handling, and case-insensitive sorting.

February 5, 2025

by Arnošt Havelka

CORE

· 4,621 Views · 2 Likes

Detecting Patterns in Event Streams With FlinkCEP

Patterns play a big role in ESP as they help to spot important sequences or behaviors in data that keep flowing nonstop.

February 5, 2025

by Gautam Goswami

CORE

· 3,586 Views

How to Use AI With WordPress

In this article, you will learn how to use AI with WordPress, as we list a couple of plugins and tools that will be useful for automating tasks and workflows.

February 5, 2025

by Nitish Singh

CORE

· 2,100 Views