Data Engineering Resources

Build Multimodal RAG Apps With Amazon Bedrock and OpenSearch

Deploying a scalable Multimodal RAG application using Amazon Bedrock for embeddings and language models, and Amazon OpenSearch as a vector store.

March 20, 2025

by Mahesh Vaijainthymala Krishnamoorthy

· 4,371 Views · 3 Likes

Patch Management in the Age of IoT: Challenges and Solutions

IoT patch management tackles risks via automation, lightweight patches, and centralized tools, ensuring security despite device variety and resource limits.

March 20, 2025

by andrew vereen

· 4,827 Views · 1 Like

Personalized Product Recommendations in E-Commerce Using ML

Data mining and machine learning to uncover patterns in data with Support Vector Machine (SVM) and Random Forest in recommending personalized e-commerce products.

March 20, 2025

by Aditi Choudhary

· 2,695 Views · 1 Like

Memory Management in Couchbase’s Query Service

Features designed to manage memory in the Query Service. Learn about mechanisms to control the memory usage of SQL++ queries and of the overall Query engine.

March 19, 2025

by Dhanya Gowrish

· 5,130 Views · 4 Likes

AI-Powered Observability With OpenTelemetry and Prometheus

Learn how AI-driven observability transforms monitoring with proactive issue detection, smarter analysis, and seamless integration into modern IT systems.

March 19, 2025

by Vasanthi Govindaraj

· 8,130 Views · 5 Likes

Building an Agentic RAG System from Scratch

Agentic RAG combines retrieval-augmented generation with AI agents to enhance LLMs, enabling autonomous decisions, efficient context retrieval, and flexible tool use.

March 19, 2025

by Swati Tyagi

· 4,571 Views · 2 Likes

Stream Gatherers: Intro to Intermediate Operations Modeler

Gatherers is a new and powerful API that enhances the Stream API by modeling intermediate operations and allowing the definition of custom intermediate operations.

March 19, 2025

by Hüseyin Akdoğan

CORE

· 9,676 Views · 3 Likes

OpenAI vs Ollama Using LangChain's SQLDatabaseToolkit

Learn about LangChain's SQLDatabaseToolkit for NL-to-SQL queries and compare OpenAI and Ollama results, highlighting setup, examples, and tool performance.

March 19, 2025

by Akmal Chaudhri

CORE

· 5,221 Views · 5 Likes

Unlocking Oracle 23 AI's JSON Relational Duality

Oracle 23ai combines AI with JSON and relational duality, allowing easy querying and updates across both formats. Learn how this integration streamlines data management.

March 19, 2025

by arvind toorpu

CORE

· 3,321 Views · 3 Likes

AI-Driven Kubernetes Troubleshooting With DeepSeek and k8sgpt

Learn Kubernetes troubleshooting with k8sgpt and DeepSeek via Groq API. AI-powered SRE Copilot automates debugging, root cause analysis, and fixes.

March 19, 2025

by Rajesh Gheware

CORE

· 9,647 Views · 5 Likes

Comparing DuckDB, Snowflake, and Databricks

In this article, we do an in-depth comparison of DuckDB, Snowflake, and Databricks to help you find the best data processing platform for your organization.

March 19, 2025

by Noa Shavit

· 4,454 Views · 1 Like

Building a Distributed Multi-Language Data Science System

The starter consists of hexagonal microservices (MERN monorepo, Spring Boot Camel, Flask), Gateway, Eureka, that communicate via REST, GraphQL, gRPC, and AMQP.

March 18, 2025

by Alexander Eleseev

CORE

· 3,991 Views · 3 Likes

Accelerating AI: A Dive into Flash Attention and Its Impact

In this article, we will explore the Flash Attention mechanism and its approach to addressing GPU acceleration with a short demo.

March 18, 2025

by Kailash Thiyagarajan

· 3,961 Views

Financial Data and RAG Usage in LLMs

AI in finance uses LLMs and RAG to assess credit risk, process data, and adapt in real-time, improving decision-making and operational efficiency.

March 18, 2025

by Ajay Tanikonda

· 2,774 Views · 1 Like

Role of Data Annotation Services in AI-Powered Manufacturing

Learn how data annotation services enhance AI-powered manufacturing by improving automation, precision, and decision-making, with their key benefits and applications.

March 18, 2025

by Peter Leo

· 2,405 Views · 2 Likes

Frugal AI: How Efficiency is Reshaping the Future of Tech

Frugal AI optimizes efficiency, reduces resource consumption and environmental impact while maintaining high performance. AI can be powerful without being wasteful.

March 18, 2025

by Frederic Jacquet

CORE

· 3,269 Views · 3 Likes

Bridging Cloud and On-Premises Log Processing

This article emphasizes on the feasibility of ingesting logs from public cloud platforms into on-premises services by highlighting key points.

March 18, 2025

by Avinash Ibbandi

· 3,520 Views · 3 Likes

Exploring Playwright’s Feature “Copy Prompt”

Playwright's new "Copy prompt" feature simplifies debugging by generating detailed prompts for LLMs like ChatGPT. This enhances testing efficiency and precision.

March 18, 2025

by Kailash Pathak

CORE

· 3,985 Views · 2 Likes

SAP HANA Triggers: Enhancing Database Logic and Automation

Learn about SAP HANA triggers, their types, use cases, and best practices to automate tasks, enforce business rules, and optimize database operations.

March 18, 2025

by Govinda Rao Banothu

· 3,238 Views

Secure File Transfer as a Critical Component for AI Success

This article intends to highlight the importance of secure file transfer and its role in support of an organization's artificial intelligence (AI) initiatives.

March 18, 2025

by Anil Soni

· 2,717 Views · 2 Likes

The Latest Data Engineering Topics