Data Resources

Problem Analysis in Apache Doris StreamLoad Scenarios

Troubleshoot common Apache Doris StreamLoad import errors, including missing partitions, data type mismatches, and special character issues, for smooth syncing.

April 3, 2025

by li yy

· 6,781 Views · 3 Likes

From Zero to Meme Hero: How I Built an AI-Powered Meme Generator in React

Learn how to build an AI meme generator using OpenAI, React, Fabric.js, and DALL-E 3 and create captions, design meme canvases, and optimize costs and performance.

April 3, 2025

by Mohit Menghnani

CORE

· 7,607 Views · 4 Likes

Maintaining ML Model Accuracy With Automated Drift Detection

This tutorial demonstrates how to implement automated drift detection, triggers alerts, and automatically retrains models to maintain accuracy in production environments.

April 2, 2025

by Jesse Williams

· 3,960 Views · 2 Likes

Lessons from Migrating an Oracle Database to AWS RDS

Migrating an on-prem Oracle database to AWS RDS brings cost savings and automation but comes with performance tuning limits, upgrade challenges, and DBA restrictions.

April 2, 2025

by arvind toorpu

CORE

· 4,779 Views · 3 Likes

Bridging OT and IT: IIoT Middleware for Edge and Cloud With Kafka and Flink

Explore how IIoT middleware and data streaming tools like Kafka and Flink bridge OT and IT, enabling real-time integration and smarter industrial operations.

April 2, 2025

by Kai Wähner

CORE

· 4,814 Views · 5 Likes

Building Scalable Data Lake Using AWS

Build a secure, scalable AWS data lake with S3, Glue, and Lake Formation, and learn key components, best practices, and analytics for optimized insights.

April 1, 2025

by Digvijay Waghela

· 4,943 Views · 4 Likes

Doris vs Elasticsearch: A Comparison and Practical Cost Case Study

Apache Doris excels in analytics, SQL support, and cost efficiency, while Elasticsearch leads in text search but has higher storage costs and complexity.

March 31, 2025

by Darren Xu

· 3,965 Views · 3 Likes

Product Design vs Platform Design for Software Development

Compare platform and product design approaches for business needs. Understand their differences and compare them to find the best fit for your use case.

March 31, 2025

by Ravi Kiran Mallidi

CORE

· 4,612 Views · 5 Likes

Self-Healing Data Pipelines: The Next Big Thing in Data Engineering?

Build self-healing data pipelines on GCP using AI-powered tools like GPT-4 and Python to detect and fix errors automatically.

March 27, 2025

by Naresh Erukulla

· 10,072 Views · 1 Like

Automatic Versioning in Mobile Apps

This article presents an automatic versioning and migration framework for mobile app databases using schema hashes and seamless upgrades.

March 27, 2025

by Liewen Huang, Ph.D.

· 3,013 Views · 2 Likes

Optimized Metrics Generation With Metadata-Driven Dynamic SQL

Learn about a metadata-driven approach to generate metrics with dynamic SQL, enhancing scalability, flexibility, and efficiency in auditing and reporting.

March 27, 2025

by Tapan Parekh

· 2,927 Views · 1 Like

Ensuring Data Quality With Great Expectations and Databricks

Ensure data quality in pipelines with Great Expectations. Learn to integrate with Databricks, validate data, and automate checks for reliable datasets.

March 26, 2025

by Sairamakrishna BuchiReddy Karri

· 5,783 Views · 3 Likes

Avoid Cross-Shard Data Movement in Distributed Databases

Learn four effective strategies to optimize distributed joins, reduce network overhead, and improve query performance in sharded databases.

March 26, 2025

by Baskar Sikkayan

· 7,087 Views · 5 Likes

Jakarta NoSQL 1.0: A Way To Bring Java and NoSQL Together

Jakarta NoSQL 1.0 standardizes NoSQL integration in Java with familiar annotations, a fluent API, and support for multiple NoSQL types—boosting productivity, portability.

March 26, 2025

by Otavio Santana

CORE

· 9,593 Views · 6 Likes

A Beginner's Guide to Spark UI: Concepts and How to Use It

Understanding the fundamentals of Spark UI is essential for optimization and debugging. Although the UI is old, the information it contains is gold.

March 26, 2025

by Saransh Arora

· 3,750 Views · 4 Likes

Recursive Feature Elimination in Practice

Learn about Recursive Feature Elimination (RFE) to reduce feature count, boost accuracy, prevent overfitting, and build efficient machine learning models.

March 25, 2025

by Srinivas Gurrala

· 3,451 Views

Lakehouse: Starting With Apache Doris + S3 Tables

This is the first article in the “Lakehouse: What’s the Big Deal?” series, where I will periodically discuss Lakehouse. Your comments and discussions are welcome.

March 25, 2025

by Mingyu Chen

· 4,137 Views · 4 Likes

Text Clustering With Deepseek Reasoning

We will develop and understand a novel approach to text clustering and explain our inference results using the DeepSeek reasoning model.

March 24, 2025

by Kalpan Dharamshi

· 3,310 Views · 2 Likes

Data Lake vs. Data Warehouse vs. Data Lakehouse

The pros and cons of the legacy data warehouse, the more recent data lake, and contemporary data lakehouse architectures.

Updated March 21, 2025

by Noa Shavit

· 8,351 Views · 7 Likes

How Doris SQL Cache Saved My Daily Morning Meetings

Doris SQL Cache can intelligently remember query results and make repetitive queries as smooth as silk, thus significantly improving query performance.

March 21, 2025

by Zen Hua

· 4,235 Views · 4 Likes

The Latest Data Topics