Data Engineering Resources

System Design of an Audio Streaming Service

In this article, we will go over the audio streaming system and key design considerations to address functional and non-functional requirements.

February 11, 2025

by Gitanjali Sahoo

· 6,994 Views · 4 Likes

From Zero to Scale With AWS Serverless

Serverless scales effortlessly from zero to peak, with AWS tools like DynamoDB and Lambda enabling cost-efficient, auto-scaling apps for data and real-time workflows.

February 11, 2025

by Ravi Laudya

· 6,020 Views · 1 Like

Understanding AWS Karpenter for Kubernetes Auto-Scaling

AWS Karpenter is an auto-scaling solution for Kubernetes designed to optimize cloud architectures by offering rapid scaling and cost efficiency.

February 11, 2025

by Rajesh Gheware

CORE

· 4,820 Views · 3 Likes

Secrets Security Is the Most Important Issue For Mobile Apps

The latest OWASP Top 10 For Mobile list ranks credential mismanagement as the largest concern our applications face. Let's stop letting our secrets sprawl.

February 11, 2025

by Dwayne McDaniel

· 3,185 Views · 3 Likes

Chat Completion Models vs OpenAI Assistants API

In this article, you will learn the key differences between chat completion (like those provided via the Chat Completions endpoint) and OpenAI's Assistants API.

February 11, 2025

by Mohammed Talib

· 6,180 Views · 1 Like

SQL as the Backbone of Big Data and AI Powerhouses

SQL powers Big Data and AI with tools like BigQuery, remaining a cornerstone of data-driven innovation through its simplicity and adaptability.

February 11, 2025

by Medha Gupta

· 3,662 Views · 1 Like

Perfecting CRUD Functionality in NextJS

CRUD operations are essential for data management. Learn how to manage data processing, React Query, pagination, and more efficiently with insights and examples.

February 11, 2025

by Olena Vlasenko

· 6,609 Views · 5 Likes

Indexed View for Aggregating Metrics

In this article, we will learn how to utilize the Indexed View capability of Azure SQL Server for tuning query performance and reducing latency.

February 10, 2025

by Ankur Peshin

· 4,523 Views · 1 Like

An In-Depth Guide to Threads in OpenAI Assistants API

Learn how to use OpenAI's Assistants API to manage threads and messages — create, list, retrieve, modify, delete — plus handle files, metadata, and more.

February 10, 2025

by Mohammed Talib

· 11,312 Views · 4 Likes

Spring Data Neo4j: How to Update an Entity

Several options for updating data with a Spring application. This post walks through some examples using the default save method, custom queries, and projections.

February 10, 2025

by Jennifer Reif

CORE

· 7,797 Views · 2 Likes

Securing Kubernetes in Production With Wiz

Wiz simplifies Kubernetes security in production with real-time threat detection, compliance automation, and robust protection for cloud-native environments.

February 10, 2025

by Sai Sandeep Ogety

CORE

· 8,249 Views · 2 Likes

Explore Open WebUI: Your Offline AI Interface

Discussing Open WebUI, a self-hosted AI interface that runs entirely offline. Learn how to install, configure, and use it with inference engines like Ollama.

February 10, 2025

by Gunter Rotsaert

CORE

· 2,580 Views

Improving Cloud Infrastructure for Achieving AGI

Achieving AGI requires improved cloud infrastructure, including more computational power, better algorithms, real-time data handling, and energy efficiency.

February 10, 2025

by Bhala Ranganathan

CORE

· 4,104 Views · 4 Likes

Designing AI Multi-Agent Systems in Java

We will design an AI Multi Agent, using Fibry. Being backed by Actors, it allows us to take control the parallelism in great detail.

February 10, 2025

by Luca Venturi

· 7,882 Views · 2 Likes

SQL Dynamic Data Masking for Privacy and Compliance

SQL Server Dynamic Data Masking helps protect sensitive data by obscuring it from non-privileged users, ensuring compliance with GDPR, HIPAA, and PCI-DSS.

February 10, 2025

by Dorababu Nadella

· 5,159 Views · 1 Like

A Guide to Using Amazon Bedrock Prompts for LLM Integration

Easily integrate LLMs into your application, manage prompts effectively and leverage the latest in LLM application development with Amazon Bedrock.

February 7, 2025

by Adit Jamdar

· 8,710 Views

Relational DB Migration to S3 Data Lake Via AWS DMS, Part I

This article discusses the challenges faced during relational database migration to AWS using DMS, including source data, logging, and network bandwidth issues.

February 7, 2025

by Vijay Bhosale

· 5,425 Views · 3 Likes

A View on Understanding Non-Human Identities Governance

Rethinking the governance, lifecycles, and interdependencies of your machine identities is essential for eliminating secrets sprawl and reducing your attack surface.

February 7, 2025

by Dwayne McDaniel

· 4,665 Views · 6 Likes

Build an AI Browser Agent With LLMs, Playwright, Browser Use

A guide on how to build an AI browser agent using LLMs, Playwright, and Browser Use to automate web interactions, extract data, and navigate sites efficiently.

February 7, 2025

by Kailash Pathak

CORE

· 19,314 Views · 4 Likes

Control Your Services With OTEL, Jaeger, and Prometheus

In this article, we will combine OTEL, Jaeger, and Prometheus for faster, centralized observability and quick troubleshooting in distributed systems.

February 7, 2025

by Ilia Ivankin

· 5,360 Views · 3 Likes

The Latest Data Engineering Topics