Data Resources

Real-time annotation scales with LLMs, feedback loops, and active learning to handle petabyte datasets, and ensures speed, quality, and adaptability in diverse fields.

February 26, 2025

by Praneeth Reddy Vatti

· 2,984 Views · 3 Likes

Spark Job Optimization

Spark jobs can be optimized to maximize resource utilization in a cluster, improving performance and reducing costs for large-scale data processing.

February 25, 2025

by Chandra Shekar r Chekuri

· 3,245 Views · 1 Like

The Future of Data Lakehouses: Apache Iceberg Explained

This blog post is the first in a three-part series exploring Apache Iceberg and its role in modern data architectures and the emergence of data lakehouses.

February 25, 2025

by Fawaz Ghali, PhD

CORE

· 4,048 Views · 5 Likes

The Hidden Cost of Dirty Data in AI Development

Dirty data weakens AI, increases costs, introduces bias, and causes compliance risks. Strong data governance ensures reliable AI outcomes.

February 25, 2025

by Ilya Dudkin

CORE

· 3,979 Views · 3 Likes

Controlling Access to Google BigQuery Data

Secure your BigQuery data with IAM roles, authorized views, authorized datasets, authorized routines, and authorized materialized views.

February 21, 2025

by Karteek Kotamsetty

· 17,525 Views · 1 Like

Deduplication of Videos Using Fingerprints, CLIP Embeddings

Video deduplication optimizes storage by removing duplicates using techniques like segmentation, embeddings, and clustering to manage massive datasets efficiently.

February 21, 2025

by Praneeth Reddy Vatti

· 6,799 Views · 5 Likes

Scaling Image Deduplication: Finding Needles in a Haystack

Learn to efficiently deduplicate 100M+ images using distributed architectures, embeddings, FAISS for ANN search, and clustering to ensure accurate results.

February 20, 2025

by Praneeth Reddy Vatti

· 5,697 Views · 3 Likes

An Introduction to Object Mutation in JavaScript

In this article, you will learn how object mutation in JavaScript works, its pitfalls, and strategies to prevent it with relevant code examples.

February 20, 2025

by Joydip Kanjilal

CORE

· 5,773 Views

Data Pattern Automation With AI and Machine Learning

Pattern recognition and AI improve data workflows, automate insights, and drive efficiency in business processes across industries.

February 19, 2025

by Sandip Gami

· 4,054 Views · 2 Likes

Data Privacy and Governance in Real-Time Data Streaming

Real-time data streaming delivers fast insights but raises privacy and compliance risks. Use encryption, tokenization, and policy enforcement for secure streaming.

February 18, 2025

by Murugan Lakshmanan

· 3,583 Views · 1 Like

Dive Into Tokenization, Attention, and Key-Value Caching

This article covers how key-value caching works and how it helps optimize large language models. It includes a text generation process to make it easy to understand.

February 18, 2025

by Kailash Thiyagarajan

· 5,188 Views · 1 Like

Multimodal RAG With Colpali, Milvus, and VLMs

Build a multimodal RAG app with ColPali, Milvus, and a visual language model to enable Q&A on PDFs using text and visual data indexed for efficient search.

February 18, 2025

by Saumitra Srivastav

· 1,967 Views · 3 Likes

Integrating Apex With Lightning Web Components

Integrating your LWC with Apex to enable seamless communication between the frontend and backend, to provide robust data handling and processing.

February 17, 2025

by Jaseem Pookandy

CORE

· 4,283 Views · 2 Likes

Creating a Web Project: Key Steps to Identify Issues

Learn how to identify web project issues through performance analysis, effective debugging, and product metrics tracking.

February 17, 2025

by Filipp Shcherbanich

CORE

· 5,968 Views · 4 Likes

Build a Data Analytics Platform With Flask, SQL, and Redis

Building a Flask-based web app that has dynamic querying for population thresholds, Redis caching for faster queries, and secure, scalable architecture.

February 17, 2025

by Sushma Kukkadapu

· 4,894 Views · 2 Likes

From Data to Decisions: Visualizing SAP Insights With Python

SAP data insights simplified with Python: A versatile tool for advanced analytics, automation, and managing large datasets.

February 17, 2025

by Prasanna Chandran Melnatami Krishnaram

· 2,496 Views · 5 Likes

Why Cloud Matters: Building Global, Scalable Microservices

A hands-on experience: Learn how to build a Book Management Catalog Microservice using Java, Helidon, Jakarta NoSQL, and Oracle Cloud.

February 17, 2025

by Otavio Santana

CORE

· 3,839 Views · 5 Likes

ETL Generation Using GenAI

Learn about how GenAI automates ETL pipelines, generates code, adapts to schema changes, and improves data processes with speed, efficiency, and precision.

February 14, 2025

by Ramesh Daddala

· 6,381 Views · 2 Likes

Idempotency in Distributed Systems: When and Why It Matters

This article explains idempotency in distributed systems and ensuring consistent results regardless of multiple executions, with implementation and challenges.

February 13, 2025

by Sandeep Kumar Gond

· 5,055 Views

Goose Migrations for Smooth Database Changes

Migrate safely: Goose automates DB changes, version control, and rollbacks. Minimal downtime — ideal for CI/CD and high load.

February 12, 2025

by Ilia Ivankin

· 9,466 Views

The Latest Data Topics