Data Engineering Resources

Securing LLM Applications: Beyond the New OWASP LLM Top 10

The new OWASP LLM Top 10 highlights vulnerabilities unique to LLMs. However, operationalizing LLM security means weaving safeguards beyond just referencing a checklist.

September 11, 2025

by Abhishek Goswami

· 3,124 Views · 2 Likes

Optimizing Cost and Carbon Footprint With Smart Scaling on AWS: Part 2

Move beyond queue-length-based scaling and use custom metrics for granular control and build smart triggers for scaling.

September 11, 2025

by Varun Dixit

· 2,479 Views · 2 Likes

Azure VM Instance Types and Their Roles in Different Distributed Software Systems

Azure provides various VM instance types optimized for compute, memory, storage, or GPU needs, such as Databricks, Snowflake, AKS, Synapse, and Azure Functions.

September 11, 2025

by Srinivasarao Rayankula

· 19,684 Views · 3 Likes

Jakarta Query: Unifying Queries Across SQL and NoSQL in Jakarta EE 12

Jakarta EE 12 introduces Jakarta Query, a brand-new specification aiming to unify query languages across relational and non-relational databases.

September 11, 2025

by Otavio Santana

CORE

· 3,827 Views · 4 Likes

The AI Precision Anti-Pattern

Learn why to avoid the Generative AI Precision Anti-Pattern and why LLMs fail on deterministic tasks, and how to align the right tools with the right jobs.

September 11, 2025

by Stefan Wolpers

CORE

· 1,846 Views · 1 Like

AI on the Fly: Real-Time Data Streaming From Apache Kafka to Live Dashboards

Real-time data streaming plays a key role for AI models as it allows them to handle and respond to data as it comes in, instead of just using old fixed datasets.

September 11, 2025

by Gautam Goswami

CORE

· 7,118 Views

OWASP Top 10 Non-Human Identity Risks for 2025: What You Need to Know

Raising awareness on NHI security is good, but what exactly do you tell your teams? OWASP has your back with the newest research into NHI risks.

September 11, 2025

by Dwayne McDaniel

· 1,727 Views · 1 Like

Toward Explainable AI (Part 9): Bridging Theory and Practice—Conclusion: Explainability Under Real-World Conditions

Explainable AI bridges the gap between complex models and real-world accountability, helping teams build trust, ensure compliance, and make smarter decisions.

September 11, 2025

by Frederic Jacquet

CORE

· 2,234 Views · 2 Likes

A Practical Guide to API Threat Analytics in Cloud Platforms

APIs are prime attack targets, so basic security isn’t enough. Use threat analytics to filter logs, detect suspicious activity, and respond fast.

September 11, 2025

by Pragya Keshap

· 2,073 Views · 4 Likes

Supercharging Your Chatbot With Context-Aware AI on AWS

Tired of chatbots that feel like scripts? Learn how to build a context-aware, AI-powered chatbot that remembers, responds, and scales as per need.

September 10, 2025

by Jyostna Seelam

· 5,322 Views

Crafting Keys: Best Naming Strategies and Sorting Techniques in Redis

In large-scale systems, effective grouping and indexing choices often define whether queries return in milliseconds or get stuck in multi‑second blocking scans.

September 10, 2025

by Subhashini Raman

· 2,145 Views

From HTTP to Kafka: A Custom Source Connector

Learn how to implement a custom Kafka Connect HTTP source connector to integrate with HTTP endpoints, covering connector configuration, deployment and usage.

September 10, 2025

by Ion Pascari

· 4,813 Views · 5 Likes

Vibe Coding: Conversational Software Development — Part 4: Guiding AI Through Iteration

In part 4 of my 'Vibe Coding' series, learn more about conversational coding, code generation from prompts, and the future of developer productivity.

September 10, 2025

by Gaurav Gaur

CORE

· 3,494 Views · 4 Likes

Using Arrow Flight SQL to Improve Data Transfer Performance in Apache Doris

Learn how Arrow Flight SQL boosts Apache Doris data transfer up to 100x, enabling faster, efficient analysis and improved workflow in Python and Java.

September 10, 2025

by Zen Hua

· 2,164 Views · 1 Like

An Introduction to Artificial Intelligence: Neural Networks, NLP, and Word Embeddings

From a single neuron to understanding language, this article provides a short introduction to artificial intelligence for software engineers.

September 10, 2025

by Ioan Tinca

· 1,977 Views · 1 Like

Using ChartMuseum as a Helm Repository

ChartMuseum is a lightweight, open-source Helm Chart repository for Kubernetes. Learn how to deploy it, enable authentication, and integrate with CI/CD.

September 9, 2025

by Tanmay Batham

· 3,465 Views

Tutorial: RAG at Scale With Vector Databases vs Lakehouse Architectures

Learn how to scale RAG pipelines by storing embeddings in vector databases vs. lakehouses, with hands-on examples and key trade-offs.

September 9, 2025

by Vivek Venkatesan

· 3,431 Views

Understanding Table Statistics in SQL Server: Importance, Performance Impact, and Practical Examples

SQL Server table statistics guide the optimizer in building efficient query plans. DBAs must keep them updated to avoid poor performance from stale data.

September 9, 2025

by arvind toorpu

CORE

· 3,787 Views · 2 Likes

How to Use Jenkins Effectively With ECS/EKS Cluster

Jenkins on AWS ECS/EKS boosts CI/CD with scalability, cost-efficiency, and automation, using AI-driven dynamic scaling, security, and monitoring

September 9, 2025

by Bibin Skaria

· 3,169 Views · 2 Likes

Probably Secure: A Look at the Security Concerns of Deterministic vs Probabilistic Systems

Learn why deterministic security remains essential in an AI-driven world and how to combine probability and proof for safe, auditable development with LLMs.

September 9, 2025

by Dwayne McDaniel

· 1,696 Views · 1 Like

The Latest Data Engineering Topics