Data Engineering Resources

Mastering AI Agents: How Agentic Design Patterns Make Agents Smarter

Discover how Agentic Design Patterns can transform your AI workflows by breaking down complex tasks into manageable, specialized AI agents.

October 7, 2024

by Noorain Panjwani

· 7,466 Views · 4 Likes

Integrate Spring Boot With jOOQ, Liquibase, and Testcontainers

Get started with jOOQ, Liquibase, and Testcontainers: Create a basic Spring Boot application and integrate the aforementioned techniques including a test setup.

October 7, 2024

by Gunter Rotsaert

CORE

· 5,955 Views · 1 Like

Natural Language SQL Query Application

Walk through building a powerful and intuitive web application that converts natural language into SQL queries and retrieves data from a PostgreSQL database.

October 7, 2024

by Balusamy Nachiappan

· 5,195 Views · 2 Likes

In-House Model Serving Infrastructure for GPU Flexibility

In this article, learn how to create a GPU SKU-agnostic serving infrastructure for flexibility, efficiency, and resilience.

October 7, 2024

by Suruchi Shah

· 5,241 Views · 1 Like

Low Code AI Agent Using Kumologica and Anthropic AI for Customer Feedback Sentiment Analysis

The article covers the design and implementation of a low code AI agent developed using Kumologica and Anthropic AI for customer feedback sentiment analysis.

October 7, 2024

by Pranav K

CORE

· 2,797 Views · 2 Likes

The Disruptive Potential of On-Device Large Language Models

Explore the advancements of on-device AI and how it will revolutionize our daily interactions with technology, making our lives more efficient and connected.

October 7, 2024

by Rishab Mehra

· 7,497 Views · 9 Likes

Curating Efficient Distributed Application Runtime (Dapr) Workflows

With Dapr and its powerful abstractions, writing resilient workflows is easy. In this article, we will understand how to write one with an example.

October 4, 2024

by Siri Varma Vegiraju

CORE

· 10,173 Views · 4 Likes

How to Build a RAG-Powered Chatbot With Google Gemini and MyScaleDB

Learn to construct a RAG-powered chatbot using Google Gemini models and MyScaleDB, including installing dependencies, preparing data, generating embeddings,etc.

October 4, 2024

by Usama Jamil

· 3,638 Views · 2 Likes

Enhanced API Security: Fine-Grained Access Control Using OPA and Kong Gateway

Kong secures APIs and OPA handles policy decisions. This custom plugin caches user data, minimizing database checks and ensuring fast, accurate access control.

October 4, 2024

by Amrutha Paladugu

· 7,048 Views · 5 Likes

How to Create a Search Engine and Algorithm With ClickHouse and Snowflake

Explore a step-by-step guide to developing a search engine and algorithm using Clickhouse, an open-source data warehousing solution.

October 3, 2024

by Akash Mukherjee

· 5,029 Views · 2 Likes

Implementing Polling With RxJS

Learn how to implement polling with RxJS for efficient, repetitive API calls, and optimize performance with exponential backoff and advanced RxJS operators.

October 3, 2024

by Aliaksandr Mirankou

· 8,022 Views · 1 Like

Why Doesn't Postgres Use My Index?

It may happen that we create an index, but PostgreSQL doesn’t use it. What could be the reason, and how can we fix it?

October 3, 2024

by Adam Furmanek

CORE

· 4,915 Views · 8 Likes

Supercharge Your Search With GenAI: From Simple Queries to Smarter Results

Boost your search with GenAI models for smarter, more relevant results using query expansion and reformulation using Chain of Thought prompting.

October 3, 2024

by Suruchi Shah

· 3,809 Views · 4 Likes

A Comprehensive Guide to Database Sharding: Building Scalable Systems

Explore an in-depth guide to database sharding: what it is, its types, how to select shard keys, and route queries for building scalable systems.

October 2, 2024

by Suleiman Dibirov

CORE

· 8,868 Views · 8 Likes

Hyperscale Data Centers Ignite Construction Surge

Demand is growing for robust computing. However, hyperscale data center construction faces challenges due to technology demands, shortages, and regulations.

October 2, 2024

by Emily Newton

· 5,152 Views · 1 Like

Key Considerations for Effective AI/ML Deployments in Kubernetes

Learn about managing AI/ML workloads in Kubernetes and follow a step-by-step tutorial for deploying a sample TensorFlow-based sentiment analysis model.

October 2, 2024

by Rajesh Gheware

CORE

· 9,645 Views · 2 Likes

Transforming Manufacturing: AI-Driven Quality Control and Predictive Maintenance Using Cloud and IoT

In modern manufacturing, the key to sustaining product reliability, compliance, and efficiency lies in robust quality control and advanced maintenance management.

October 2, 2024

by vuppulapati Chandra Sekhar Naidu

· 4,654 Views · 1 Like

Top 6 Cybersecurity Threat Detection Use Cases: How AI/ML Can Help Detect Advanced and Emerging Threats

Learn how to get started to design and build AI/ML solutions that are capable of revolutionizing the cybersecurity threat detection landscape.

October 2, 2024

by Mayank Singhi

· 4,070 Views · 2 Likes

AWS LetsEncrypt Lambda or Why I Wrote a Custom TLS Provider for AWS Using OpenTofu and Go

LetsEncrypt Lambda helps to manage TLS certificates. Compared to Certificate Manager it provides certs that can be used at non-only AWS services like EC2 Nginx.

October 2, 2024

by Alexander Sharov

· 7,606 Views · 3 Likes

Misconfiguration Madness: Thwarting Common Vulnerabilities in the Financial Sector

Financial services are among the most attacked sectors of any industry, making it critical that developers operate at the highest level to produce secure code.

October 2, 2024

by Matias Madou

· 4,062 Views · 2 Likes

The Latest Data Engineering Topics