Data Engineering Resources

In-House Model Serving Infrastructure for GPU Flexibility

In this article, learn how to create a GPU SKU-agnostic serving infrastructure for flexibility, efficiency, and resilience.

October 7, 2024

by Suruchi Shah

· 4,160 Views · 1 Like

Low Code AI Agent Using Kumologica and Anthropic AI for Customer Feedback Sentiment Analysis

The article covers the design and implementation of a low code AI agent developed using Kumologica and Anthropic AI for customer feedback sentiment analysis.

October 7, 2024

by Pranav K

CORE

· 1,936 Views · 2 Likes

The Disruptive Potential of On-Device Large Language Models

Explore the advancements of on-device AI and how it will revolutionize our daily interactions with technology, making our lives more efficient and connected.

October 7, 2024

by Rishab Mehra

· 2,279 Views · 2 Likes

Curating Efficient Distributed Application Runtime (Dapr) Workflows

With Dapr and its powerful abstractions, writing resilient workflows is easy. In this article, we will understand how to write one with an example.

October 4, 2024

by Siri Varma Vegiraju

CORE

· 6,606 Views · 4 Likes

How to Build a RAG-Powered Chatbot With Google Gemini and MyScaleDB

Learn to construct a RAG-powered chatbot using Google Gemini models and MyScaleDB, including installing dependencies, preparing data, generating embeddings,etc.

October 4, 2024

by Usama Jamil

· 3,175 Views · 2 Likes

Enhanced API Security: Fine-Grained Access Control Using OPA and Kong Gateway

Kong secures APIs and OPA handles policy decisions. This custom plugin caches user data, minimizing database checks and ensuring fast, accurate access control.

October 4, 2024

by Amrutha Paladugu

· 5,079 Views · 4 Likes

How to Create a Search Engine and Algorithm With ClickHouse and Snowflake

Explore a step-by-step guide to developing a search engine and algorithm using Clickhouse, an open-source data warehousing solution.

October 3, 2024

by Akash Mukherjee

· 3,823 Views · 2 Likes

Implementing Polling With RxJS

Learn how to implement polling with RxJS for efficient, repetitive API calls, and optimize performance with exponential backoff and advanced RxJS operators.

October 3, 2024

by Aliaksandr Mirankou

· 6,029 Views · 1 Like

Why Doesn't Postgres Use My Index?

It may happen that we create an index, but PostgreSQL doesn’t use it. What could be the reason, and how can we fix it?

October 3, 2024

by Adam Furmanek

CORE

· 4,382 Views · 7 Likes

Supercharge Your Search With GenAI: From Simple Queries to Smarter Results

Boost your search with GenAI models for smarter, more relevant results using query expansion and reformulation using Chain of Thought prompting.

October 3, 2024

by Suruchi Shah

· 2,897 Views · 4 Likes

A Comprehensive Guide to Database Sharding: Building Scalable Systems

Explore an in-depth guide to database sharding: what it is, its types, how to select shard keys, and route queries for building scalable systems.

October 2, 2024

by Suleiman Dibirov

CORE

· 6,672 Views · 8 Likes

Hyperscale Data Centers Ignite Construction Surge

Demand is growing for robust computing. However, hyperscale data center construction faces challenges due to technology demands, shortages, and regulations.

October 2, 2024

by Emily Newton

· 4,326 Views · 1 Like

Key Considerations for Effective AI/ML Deployments in Kubernetes

Learn about managing AI/ML workloads in Kubernetes and follow a step-by-step tutorial for deploying a sample TensorFlow-based sentiment analysis model.

October 2, 2024

by Rajesh Gheware

CORE

· 7,193 Views · 2 Likes

Transforming Manufacturing: AI-Driven Quality Control and Predictive Maintenance Using Cloud and IoT

In modern manufacturing, the key to sustaining product reliability, compliance, and efficiency lies in robust quality control and advanced maintenance management.

October 2, 2024

by vuppulapati Chandra Sekhar Naidu

· 3,462 Views · 1 Like

Top 6 Cybersecurity Threat Detection Use Cases: How AI/ML Can Help Detect Advanced and Emerging Threats

Learn how to get started to design and build AI/ML solutions that are capable of revolutionizing the cybersecurity threat detection landscape.

October 2, 2024

by Mayank Singhi

· 3,282 Views · 2 Likes

AWS LetsEncrypt Lambda or Why I Wrote a Custom TLS Provider for AWS Using OpenTofu and Go

LetsEncrypt Lambda helps to manage TLS certificates. Compared to Certificate Manager it provides certs that can be used at non-only AWS services like EC2 Nginx.

October 2, 2024

by Alexander Sharov

· 6,737 Views · 2 Likes

Misconfiguration Madness: Thwarting Common Vulnerabilities in the Financial Sector

Financial services are among the most attacked sectors of any industry, making it critical that developers operate at the highest level to produce secure code.

October 2, 2024

by Matias Madou

· 3,574 Views · 1 Like

How JavaScript DataTable Libraries Address Challenging Requirements in Web Data Management

This article highlights challenging project requirements on JS grid tables and how popular UI libraries help solve arising issues.

October 2, 2024

by Ivan Petrenko

· 3,789 Views · 1 Like

Unit Integration Testing With Testcontainers Docker Compose

Is your test dependent on multiple other applications? Do you want to create an integration test using Testcontainers? Learn about the Docker Compose Module.

October 2, 2024

by Gunter Rotsaert

CORE

· 5,014 Views · 1 Like

Leveraging Artificial Intelligence for Software Testing to Test Healthcare Applications

Learn how leveraging AI-powered software testing for healthcare domains can make a significant difference in the quality, efficiency, and reliability of care.

October 1, 2024

by Vikram Singh

· 3,440 Views · 5 Likes

The Latest Data Engineering Topics