Data Engineering Resources

Integrating AI Agent Workflows in the SOC

As our reliance on AI-enabled hyper-automation increases, we will leverage human expertise to design robust workflows capable of managing repetitive tasks.

February 25, 2025

by Keyur Rajyaguru

· 4,338 Views

Simplifying Multi-LLM Integration With KubeMQ

Using a message broker as a router to handle requests between your apps and LLMs simplifies integration, improves reliability, and scales easily for AI-driven apps.

February 25, 2025

by John Vester

CORE

· 21,923 Views · 3 Likes

A Comprehensive Guide to IAM in Object Storage

In this article, learn about identity access management, service IDs, service credentials, and their role in securing access to object storage on the cloud.

February 25, 2025

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 5,579 Views · 6 Likes

Codify Your Cloud and Kubernetes With Crossplane and IaC

Crossplane enables Kubernetes-native IaC, letting platform engineers define custom APIs for provisioning, enforcing governance, and providing self-service infrastructure.

February 24, 2025

by Josephine Eskaline Joyce

CORE

· 5,836 Views · 5 Likes

Use Azure Cosmos DB as a Docker Container in CI/CD Pipelines

Azure Cosmos DB Emulator simplifies local development by enabling testing without Azure costs. This example uses it as a service container for CI workflows.

February 24, 2025

by Abhishek Gupta

CORE

· 4,590 Views · 1 Like

Tips to Choose the Right SQL Database

It’s the same in the world of data, where choosing the right SQL database can make or break your organization’s success.

February 24, 2025

by Pavan Belagatti

CORE

· 3,021 Views · 1 Like

API Mesh: The Next Big Leap in Distributed Backend Systems

API Mesh simplifies API management across distributed systems by unifying orchestration, enhancing security, optimizing routing, and improving scalability.

February 24, 2025

by Gautam Solaimalai

· 4,028 Views · 2 Likes

The Perceptron Algorithm and the Kernel Trick

The Perceptron Algorithm is a foundational linear classifier for binary tasks, influencing modern ML with concepts like iterative weight updates and activation functions.

February 24, 2025

by Salman Khan

CORE

· 3,351 Views · 2 Likes

In this article, you will learn how to create a secure login system using HTML, PHP, and MySQL, covering key steps from registration to logout.

Updated February 24, 2025

by Neil Agarwal

· 423,991 Views · 12 Likes

Simplify Your Compliance With Google Cloud Assured Workloads

Google Cloud Assured Workloads lets you create compliant environments, monitor for violations, and audit against major compliance frameworks.

February 24, 2025

by Karteek Kotamsetty

· 18,751 Views · 1 Like

How to Quarantine a Malicious File in Java

Quarantining malicious files has advantages over outright deleting. With the right tools, we can store malicious content in an isolated directory.

February 24, 2025

by Brian O'Neill

CORE

· 7,358 Views · 3 Likes

Build a Local AI-Powered Document Summarization Tool

Learn how to build a simple document summarizer using Streamlit for the interface and Ollama for running AI models locally.

February 24, 2025

by Vamsi Kavuri

CORE

· 31,813 Views · 4 Likes

Designing a Blog Application Using Document Databases

Learn how to design a blog application using document databases. Easily manage efficient querying and features like comments and tags.

February 21, 2025

by Bhrigu Srivastava

· 4,654 Views · 4 Likes

Controlling Access to Google BigQuery Data

Secure your BigQuery data with IAM roles, authorized views, authorized datasets, authorized routines, and authorized materialized views.

February 21, 2025

by Karteek Kotamsetty

· 17,850 Views · 1 Like

A Comprehensive Guide to Generative AI Training

Detailed technical guide covering the complete lifecycle of LLM development, from raw text pre-training through instruction tuning to human alignment.

February 21, 2025

by Vashishtha Patil

· 9,654 Views · 6 Likes

Deduplication of Videos Using Fingerprints, CLIP Embeddings

Video deduplication optimizes storage by removing duplicates using techniques like segmentation, embeddings, and clustering to manage massive datasets efficiently.

February 21, 2025

by Praneeth Reddy Vatti

· 6,985 Views · 5 Likes

Step-by-Step Reasoning Can Fix Madman Logic in Vision AI

LlamaV-o1 outperforms Gemini-1.5-Flash and Claude-3.5-Sonnet on pattern recognition by explaining its reasoning process step by step.

February 21, 2025

by mike labs

· 3,904 Views · 1 Like

Building a Simple RAG Application With Java and Quarkus

With Java’s versatility and Quarkus’s cloud-native optimizations, you can build high-performance, scalable applications that seamlessly integrate AI-driven features.

February 21, 2025

by Daniel Oh

CORE

· 9,141 Views · 6 Likes

Solving Interface Challenges With the BFF Pattern

A BFF is a back-end service tailored to a specific user interface or experience. Instead of using one API for all platforms, each client has its own dedicated backend.

February 20, 2025

by Narendra Lakshmana gowda

· 5,272 Views · 4 Likes

AI Agents: Future of Automation or Overhyped Buzzword?

AI Agents perceive, decide, and act independently, continuously learning and adapting to automate complex tasks with minimal human intervention.

February 20, 2025

by Graziano Casto

CORE

· 4,744 Views · 2 Likes

The Latest Data Engineering Topics