Data Resources

Lessons from Migrating an Oracle Database to AWS RDS

Migrating an on-prem Oracle database to AWS RDS brings cost savings and automation but comes with performance tuning limits, upgrade challenges, and DBA restrictions.

April 2, 2025

by arvind toorpu

CORE

· 4,508 Views · 3 Likes

Bridging OT and IT: IIoT Middleware for Edge and Cloud With Kafka and Flink

Explore how IIoT middleware and data streaming tools like Kafka and Flink bridge OT and IT, enabling real-time integration and smarter industrial operations.

April 2, 2025

by Kai Wähner

CORE

· 4,528 Views · 4 Likes

Building Scalable Data Lake Using AWS

Build a secure, scalable AWS data lake with S3, Glue, and Lake Formation, and learn key components, best practices, and analytics for optimized insights.

April 1, 2025

by Digvijay Waghela

· 4,570 Views · 3 Likes

Doris vs Elasticsearch: A Comparison and Practical Cost Case Study

Apache Doris excels in analytics, SQL support, and cost efficiency, while Elasticsearch leads in text search but has higher storage costs and complexity.

March 31, 2025

by Darren Xu

· 3,629 Views · 2 Likes

Product Design vs Platform Design for Software Development

Compare platform and product design approaches for business needs. Understand their differences and compare them to find the best fit for your use case.

March 31, 2025

by Ravi Kiran Mallidi

CORE

· 4,132 Views · 5 Likes

Self-Healing Data Pipelines: The Next Big Thing in Data Engineering?

Build self-healing data pipelines on GCP using AI-powered tools like GPT-4 and Python to detect and fix errors automatically.

March 27, 2025

by Naresh Erukulla

· 9,530 Views

Automatic Versioning in Mobile Apps

This article presents an automatic versioning and migration framework for mobile app databases using schema hashes and seamless upgrades.

March 27, 2025

by Liewen Huang, Ph.D.

· 2,763 Views · 2 Likes

Optimized Metrics Generation With Metadata-Driven Dynamic SQL

Learn about a metadata-driven approach to generate metrics with dynamic SQL, enhancing scalability, flexibility, and efficiency in auditing and reporting.

March 27, 2025

by Tapan Parekh

· 2,787 Views · 1 Like

Ensuring Data Quality With Great Expectations and Databricks

Ensure data quality in pipelines with Great Expectations. Learn to integrate with Databricks, validate data, and automate checks for reliable datasets.

March 26, 2025

by Sairamakrishna BuchiReddy Karri

· 5,267 Views · 2 Likes

Avoid Cross-Shard Data Movement in Distributed Databases

Learn four effective strategies to optimize distributed joins, reduce network overhead, and improve query performance in sharded databases.

March 26, 2025

by Baskar Sikkayan

· 6,470 Views · 5 Likes

Jakarta NoSQL 1.0: A Way To Bring Java and NoSQL Together

Jakarta NoSQL 1.0 standardizes NoSQL integration in Java with familiar annotations, a fluent API, and support for multiple NoSQL types—boosting productivity, portability.

March 26, 2025

by Otavio Santana

CORE

· 9,234 Views · 5 Likes

A Beginner's Guide to Spark UI: Concepts and How to Use It

Understanding the fundamentals of Spark UI is essential for optimization and debugging. Although the UI is old, the information it contains is gold.

March 26, 2025

by Saransh Arora

· 3,324 Views · 3 Likes

Recursive Feature Elimination in Practice

Learn about Recursive Feature Elimination (RFE) to reduce feature count, boost accuracy, prevent overfitting, and build efficient machine learning models.

March 25, 2025

by Srinivas Gurrala

· 3,097 Views

Lakehouse: Starting With Apache Doris + S3 Tables

This is the first article in the “Lakehouse: What’s the Big Deal?” series, where I will periodically discuss Lakehouse. Your comments and discussions are welcome.

March 25, 2025

by Mingyu Chen

· 3,829 Views · 3 Likes

Text Clustering With Deepseek Reasoning

We will develop and understand a novel approach to text clustering and explain our inference results using the DeepSeek reasoning model.

March 24, 2025

by Kalpan Dharamshi

· 2,993 Views · 2 Likes

Data Lake vs. Data Warehouse vs. Data Lakehouse

The pros and cons of the legacy data warehouse, the more recent data lake, and contemporary data lakehouse architectures.

Updated March 21, 2025

by Noa Shavit

· 7,499 Views · 6 Likes

How Doris SQL Cache Saved My Daily Morning Meetings

Doris SQL Cache can intelligently remember query results and make repetitive queries as smooth as silk, thus significantly improving query performance.

March 21, 2025

by Zen Hua

· 4,029 Views · 4 Likes

Patch Management in the Age of IoT: Challenges and Solutions

IoT patch management tackles risks via automation, lightweight patches, and centralized tools, ensuring security despite device variety and resource limits.

March 20, 2025

by andrew vereen

· 4,819 Views · 1 Like

Personalized Product Recommendations in E-Commerce Using ML

Data mining and machine learning to uncover patterns in data with Support Vector Machine (SVM) and Random Forest in recommending personalized e-commerce products.

March 20, 2025

by Aditi Choudhary

· 2,684 Views · 1 Like

Memory Management in Couchbase’s Query Service

Features designed to manage memory in the Query Service. Learn about mechanisms to control the memory usage of SQL++ queries and of the overall Query engine.

March 19, 2025

by Dhanya Gowrish

· 5,126 Views · 4 Likes

The Latest Data Topics