Data Engineering Resources

Understanding AWS Karpenter for Kubernetes Auto-Scaling

AWS Karpenter is an auto-scaling solution for Kubernetes designed to optimize cloud architectures by offering rapid scaling and cost efficiency.

February 11, 2025

by Rajesh Gheware

CORE

· 4,960 Views · 3 Likes

Secrets Security Is the Most Important Issue For Mobile Apps

The latest OWASP Top 10 For Mobile list ranks credential mismanagement as the largest concern our applications face. Let's stop letting our secrets sprawl.

February 11, 2025

by Dwayne McDaniel

· 3,248 Views · 3 Likes

Chat Completion Models vs OpenAI Assistants API

In this article, you will learn the key differences between chat completion (like those provided via the Chat Completions endpoint) and OpenAI's Assistants API.

February 11, 2025

by Mohammed Talib

· 10,711 Views · 1 Like

SQL as the Backbone of Big Data and AI Powerhouses

SQL powers Big Data and AI with tools like BigQuery, remaining a cornerstone of data-driven innovation through its simplicity and adaptability.

February 11, 2025

by Medha Gupta

· 3,869 Views · 2 Likes

Perfecting CRUD Functionality in NextJS

CRUD operations are essential for data management. Learn how to manage data processing, React Query, pagination, and more efficiently with insights and examples.

February 11, 2025

by Olena Vlasenko

· 6,819 Views · 5 Likes

Indexed View for Aggregating Metrics

In this article, we will learn how to utilize the Indexed View capability of Azure SQL Server for tuning query performance and reducing latency.

February 10, 2025

by Ankur Peshin

· 4,664 Views · 1 Like

An In-Depth Guide to Threads in OpenAI Assistants API

Learn how to use OpenAI's Assistants API to manage threads and messages — create, list, retrieve, modify, delete — plus handle files, metadata, and more.

February 10, 2025

by Mohammed Talib

· 11,691 Views · 4 Likes

Spring Data Neo4j: How to Update an Entity

Several options for updating data with a Spring application. This post walks through some examples using the default save method, custom queries, and projections.

February 10, 2025

by Jennifer Reif

CORE

· 8,057 Views · 2 Likes

Securing Kubernetes in Production With Wiz

Wiz simplifies Kubernetes security in production with real-time threat detection, compliance automation, and robust protection for cloud-native environments.

February 10, 2025

by Sai Sandeep Ogety

CORE

· 8,491 Views · 2 Likes

Explore Open WebUI: Your Offline AI Interface

Discussing Open WebUI, a self-hosted AI interface that runs entirely offline. Learn how to install, configure, and use it with inference engines like Ollama.

February 10, 2025

by Gunter Rotsaert

CORE

· 2,726 Views

Improving Cloud Infrastructure for Achieving AGI

Achieving AGI requires improved cloud infrastructure, including more computational power, better algorithms, real-time data handling, and energy efficiency.

February 10, 2025

by Bhala Ranganathan

CORE

· 4,298 Views · 4 Likes

Designing AI Multi-Agent Systems in Java

We will design an AI Multi Agent, using Fibry. Being backed by Actors, it allows us to take control the parallelism in great detail.

February 10, 2025

by Luca Venturi

· 7,994 Views · 2 Likes

SQL Dynamic Data Masking for Privacy and Compliance

SQL Server Dynamic Data Masking helps protect sensitive data by obscuring it from non-privileged users, ensuring compliance with GDPR, HIPAA, and PCI-DSS.

February 10, 2025

by Dorababu Nadella

· 5,404 Views · 1 Like

A Guide to Using Amazon Bedrock Prompts for LLM Integration

Easily integrate LLMs into your application, manage prompts effectively and leverage the latest in LLM application development with Amazon Bedrock.

February 7, 2025

by Adit Jamdar

· 8,908 Views

Relational DB Migration to S3 Data Lake Via AWS DMS, Part I

This article discusses the challenges faced during relational database migration to AWS using DMS, including source data, logging, and network bandwidth issues.

February 7, 2025

by Vijay Bhosale

· 5,584 Views · 4 Likes

A View on Understanding Non-Human Identities Governance

Rethinking the governance, lifecycles, and interdependencies of your machine identities is essential for eliminating secrets sprawl and reducing your attack surface.

February 7, 2025

by Dwayne McDaniel

· 4,745 Views · 6 Likes

Build an AI Browser Agent With LLMs, Playwright, Browser Use

A guide on how to build an AI browser agent using LLMs, Playwright, and Browser Use to automate web interactions, extract data, and navigate sites efficiently.

February 7, 2025

by Kailash Pathak

CORE

· 19,965 Views · 4 Likes

Control Your Services With OTEL, Jaeger, and Prometheus

In this article, we will combine OTEL, Jaeger, and Prometheus for faster, centralized observability and quick troubleshooting in distributed systems.

February 7, 2025

by Ilia Ivankin

· 5,636 Views · 4 Likes

Data Management With PostgreSQL Partitioning and pg_partman

PostgreSQL table partitioning divides large tables into smaller segments to boost query performance, simplify maintenance, and enable scalable data management.

February 7, 2025

by arvind toorpu

CORE

· 4,375 Views · 1 Like

Exploring Operator, OpenAI’s New AI Agent

OpenAI has introduced its new AI agent, Operator. See how it can streamline software testing, reduce manual effort, and enhance accuracy with automation.

February 6, 2025

by Kailash Pathak

CORE

· 5,660 Views · 3 Likes

The Latest Data Engineering Topics