Data Resources

The Shift Left Architecture: From Batch and Lakehouse to Data Streaming

Explore the Shift Left Architecture using data streaming (Kafka/Flink) that enables data products for DWH, data lake, and lakehouses like Snowflake/Databricks.

October 8, 2024

by Kai Wähner

CORE

· 3,486 Views · 1 Like

The Disruptive Potential of On-Device Large Language Models

Explore the advancements of on-device AI and how it will revolutionize our daily interactions with technology, making our lives more efficient and connected.

October 7, 2024

by Rishab Mehra

· 2,312 Views · 2 Likes

Curating Efficient Distributed Application Runtime (Dapr) Workflows

With Dapr and its powerful abstractions, writing resilient workflows is easy. In this article, we will understand how to write one with an example.

October 4, 2024

by Siri Varma Vegiraju

CORE

· 6,640 Views · 4 Likes

How to Build a RAG-Powered Chatbot With Google Gemini and MyScaleDB

Learn to construct a RAG-powered chatbot using Google Gemini models and MyScaleDB, including installing dependencies, preparing data, generating embeddings,etc.

October 4, 2024

by Usama Jamil

· 3,199 Views · 2 Likes

Enhanced API Security: Fine-Grained Access Control Using OPA and Kong Gateway

Kong secures APIs and OPA handles policy decisions. This custom plugin caches user data, minimizing database checks and ensuring fast, accurate access control.

October 4, 2024

by Amrutha Paladugu

· 5,114 Views · 4 Likes

Why Doesn't Postgres Use My Index?

It may happen that we create an index, but PostgreSQL doesn’t use it. What could be the reason, and how can we fix it?

October 3, 2024

by Adam Furmanek

CORE

· 4,407 Views · 7 Likes

A Comprehensive Guide to Database Sharding: Building Scalable Systems

Explore an in-depth guide to database sharding: what it is, its types, how to select shard keys, and route queries for building scalable systems.

October 2, 2024

by Suleiman Dibirov

CORE

· 6,726 Views · 8 Likes

Hyperscale Data Centers Ignite Construction Surge

Demand is growing for robust computing. However, hyperscale data center construction faces challenges due to technology demands, shortages, and regulations.

October 2, 2024

by Emily Newton

· 4,343 Views · 1 Like

Transforming Manufacturing: AI-Driven Quality Control and Predictive Maintenance Using Cloud and IoT

In modern manufacturing, the key to sustaining product reliability, compliance, and efficiency lies in robust quality control and advanced maintenance management.

October 2, 2024

by vuppulapati Chandra Sekhar Naidu

· 3,493 Views · 1 Like

Misconfiguration Madness: Thwarting Common Vulnerabilities in the Financial Sector

Financial services are among the most attacked sectors of any industry, making it critical that developers operate at the highest level to produce secure code.

October 2, 2024

by Matias Madou

· 3,585 Views · 1 Like

How JavaScript DataTable Libraries Address Challenging Requirements in Web Data Management

This article highlights challenging project requirements on JS grid tables and how popular UI libraries help solve arising issues.

October 2, 2024

by Ivan Petrenko

· 3,815 Views · 1 Like

Unit Integration Testing With Testcontainers Docker Compose

Is your test dependent on multiple other applications? Do you want to create an integration test using Testcontainers? Learn about the Docker Compose Module.

October 2, 2024

by Gunter Rotsaert

CORE

· 5,027 Views · 1 Like

Workarounds for Oracle Restrictions on the Size of Expression Lists

Learn five strategies to workaround ORA-01795 and ORA-00913 errors and explore a comparative analysis of their performance.

October 1, 2024

by Thiago Nascimento

CORE

· 6,169 Views · 3 Likes

Best Practices for Market Data Replay

Based on DolphinDB’s streaming replay, distributed database architecture, and APIs, you can create a tool for historical insight and model back-testing.

October 1, 2024

by Davis Zhou

· 2,933 Views · 1 Like

What Is Lambda Architecture? Ultimate Guide to Getting Started

Discover the basics of lambda architecture in our comprehensive guide. Explore its components, workflow, applications, and best practices.

Updated October 1, 2024

by Michael Bogan

CORE

· 14,935 Views · 11 Likes

A Hands-On Guide to OpenTelemetry: Linking Metrics to Traces With Exemplars, Part 2

This article concludes the two part series exploring how to link metrics to traces and make the most of telemetry data on your observability journey.

October 1, 2024

by Eric D. Schabell

CORE

· 3,198 Views · 2 Likes

5 Best Practices for Data Warehousing

Getting started in data warehousing is a major undertaking, so it's important to consider a few best practices before beginning.

Updated October 1, 2024

by Zac Amos

· 6,744 Views · 2 Likes

How to Improve RAG Quality by Storing Knowledge Graphs in Vector Databases

This tutorial provides an in-depth look at how to improve standard LLM and vector database RAG quality with knowledge graphs.

September 30, 2024

by Tim Spann

CORE

· 4,292 Views · 8 Likes

Transformers: Age of Attention

Explore this simple explanation of the Transformer model from the revolutionary paper "Attention is All You Need," the basis of models like BERT and GPT.

September 30, 2024

by Bhavdeep Sethi

· 32,891 Views · 2 Likes

Stream Processing in the Serverless World

Learn how real-time data processing enables businesses to gain actionable insights without the overhead of managing infrastructure.

September 30, 2024

by Rajesh Pandey

· 4,143 Views · 3 Likes

The Latest Data Topics