Data Resources

Modern ETL Architecture: dbt on Snowflake With Airflow

Build a scalable ETL pipeline with dbt, Snowflake, and Airflow, and address data engineering challenges with modular architecture, CI/CD, and best practices.

February 27, 2025

by Digvijay Waghela

· 6,306 Views · 2 Likes

Top Methods to Improve ETL Performance Using SSIS

Improve ETL performance in SSIS with parallel extraction, optimized transformations, and proper configuration of concurrency, batch sizes, and data types.

February 27, 2025

by DZone Editorial

· 5,704 Views · 1 Like

Handling Embedded Data in NoSQL With Java

Handle embedded data in NoSQL with Java using Jakarta NoSQL. Compare flat vs. grouped structures using @Embeddable to optimize document storage and querying in MongoDB.

February 27, 2025

by Otavio Santana

CORE

· 6,876 Views · 5 Likes

Efficient Multimodal Data Processing: A Technical Deep Dive

Efficient multimodal data processing using GPU-accelerated pipelines, neural networks, and hybrid storage for scalable, low-latency AI-driven applications.

February 27, 2025

by Praneeth Reddy Vatti

· 6,063 Views · 4 Likes

Cloud-Driven Analytics Solution Strategy in Healthcare

Detailed insights into compute resource management, cluster optimization, storage efficiency, and cost governance in cloud-based environments.

February 27, 2025

by Abrar Ahmed Syed

· 4,863 Views · 5 Likes

How to Scale Elasticsearch to Solve Your Scalability Issues

Scaling Elasticsearch requires balancing sharding, query performance, and memory tuning for optimal efficiency in high-traffic, real-time applications.

February 26, 2025

by Vivek Kumar

· 8,226 Views · 3 Likes

A Platform-Agnostic Approach in Cloud Security

Learn a platform-agnostic approach to cloud security, focusing on encryption, zero-trust models, and tools to enhance security across multi-cloud environments.

February 26, 2025

by Natapong Sornprom

· 3,834 Views · 2 Likes

Annotating Data at Scale in Real Time

Real-time annotation scales with LLMs, feedback loops, and active learning to handle petabyte datasets, and ensures speed, quality, and adaptability in diverse fields.

February 26, 2025

by Praneeth Reddy Vatti

· 3,053 Views · 3 Likes

Spark Job Optimization

Spark jobs can be optimized to maximize resource utilization in a cluster, improving performance and reducing costs for large-scale data processing.

February 25, 2025

by Chandra Shekar r Chekuri

· 3,335 Views · 1 Like

The Future of Data Lakehouses: Apache Iceberg Explained

This blog post is the first in a three-part series exploring Apache Iceberg and its role in modern data architectures and the emergence of data lakehouses.

February 25, 2025

by Fawaz Ghali, PhD

CORE

· 4,141 Views · 5 Likes

The Hidden Cost of Dirty Data in AI Development

Dirty data weakens AI, increases costs, introduces bias, and causes compliance risks. Strong data governance ensures reliable AI outcomes.

February 25, 2025

by Ilya Dudkin

CORE

· 4,073 Views · 3 Likes

Controlling Access to Google BigQuery Data

Secure your BigQuery data with IAM roles, authorized views, authorized datasets, authorized routines, and authorized materialized views.

February 21, 2025

by Karteek Kotamsetty

· 17,843 Views · 1 Like

Deduplication of Videos Using Fingerprints, CLIP Embeddings

Video deduplication optimizes storage by removing duplicates using techniques like segmentation, embeddings, and clustering to manage massive datasets efficiently.

February 21, 2025

by Praneeth Reddy Vatti

· 6,967 Views · 5 Likes

Scaling Image Deduplication: Finding Needles in a Haystack

Learn to efficiently deduplicate 100M+ images using distributed architectures, embeddings, FAISS for ANN search, and clustering to ensure accurate results.

February 20, 2025

by Praneeth Reddy Vatti

· 5,972 Views · 3 Likes

An Introduction to Object Mutation in JavaScript

In this article, you will learn how object mutation in JavaScript works, its pitfalls, and strategies to prevent it with relevant code examples.

February 20, 2025

by Joydip Kanjilal

CORE

· 5,946 Views

Data Pattern Automation With AI and Machine Learning

Pattern recognition and AI improve data workflows, automate insights, and drive efficiency in business processes across industries.

February 19, 2025

by Sandip Gami

· 4,181 Views · 2 Likes

Data Privacy and Governance in Real-Time Data Streaming

Real-time data streaming delivers fast insights but raises privacy and compliance risks. Use encryption, tokenization, and policy enforcement for secure streaming.

February 18, 2025

by Murugan Lakshmanan

· 3,702 Views · 1 Like

Dive Into Tokenization, Attention, and Key-Value Caching

This article covers how key-value caching works and how it helps optimize large language models. It includes a text generation process to make it easy to understand.

February 18, 2025

by Kailash Thiyagarajan

· 5,379 Views · 1 Like

Multimodal RAG With Colpali, Milvus, and VLMs

Build a multimodal RAG app with ColPali, Milvus, and a visual language model to enable Q&A on PDFs using text and visual data indexed for efficient search.

February 18, 2025

by Saumitra Srivastav

· 2,007 Views · 3 Likes

Integrating Apex With Lightning Web Components

Integrating your LWC with Apex to enable seamless communication between the frontend and backend, to provide robust data handling and processing.

February 17, 2025

by Jaseem Pookandy

CORE

· 4,496 Views · 2 Likes

The Latest Data Topics