Big Data Resources

Databricks: An Understanding Inside the WH

This article presents an understanding of Databricks with helpful links and an explanation of the author's knowledge of the topic.

December 21, 2023

by Barath Ravichander

· 4,384 Views · 1 Like

6 Best Practices to Build Data Pipelines

Explore data pipelines, the backbones of data-driven enterprises. Take a look at some of the proven best practices that can help you build one from scratch.

December 21, 2023

by Hiren Dhaduk

· 6,436 Views · 1 Like

Data Fusion and Management in IoT: Enhancing Information Accuracy and Consistency

Data fusion in IoT integrates data over time and space, detects anomalies, and improves data quality. It's vital for edge computing, QoS, and scalability.

December 21, 2023

by Deep Manishkumar Dave

· 3,787 Views · 1 Like

From Elasticsearch to Apache Doris: Upgrading an Observability Platform

An observability platform replaces its data query and storage engine and realizes 70% less storage costs and 200%~400% query performance.

December 20, 2023

by Shirley H.

· 4,145 Views · 1 Like

A Comprehensive Guide to Industrial IoT Boards

Key considerations for Industrial IoT development boards include memory, connectivity, and the microcontroller itself. Let's explore.

December 19, 2023

by Carsten Rhod Gregersen

· 3,993 Views · 1 Like

How Lufthansa Uses Apache Kafka for Data Integration and Machine Learning

The airline Lufthansa uses Apache Kafka as cloud-native middleware for data integration and as data fabric for analytics and machine learning.

December 19, 2023

by Kai Wähner

CORE

· 4,977 Views · 2 Likes

A Comparative Analysis: AWS Kinesis vs Amazon Managed Streaming for Kafka - MSK

Dive into a comparative analysis of two AWS streaming services, Kinesis and Managed Streaming for Apache Kafka, exploring their features, performance, and pricing.

December 19, 2023

by Satrajit Basu

CORE

· 6,313 Views · 4 Likes

Leveraging Apache Kafka for the Distribution of Large Messages

In this article, we will explore the architectural approach for separating the actual payload (the large video file) from the message intended to be circulated via Kafka.

December 19, 2023

by Gautam Goswami

CORE

· 4,614 Views · 4 Likes

Beyond Bytes and Bits: Law Craft in the Information Age

In this insightful piece, a prominent tech leader explores essential legal strategies tailored for app developers to safeguard user data.

December 19, 2023

by Muhammad Muzammil Rawjani

· 2,932 Views · 2 Likes

Energy Efficient Distributed Systems

A detailed analysis of energy-efficient distributed systems, exploring various techniques, strategies, and technologies used to optimize energy consumption.

December 18, 2023

by Varun Dixit

· 25,435 Views · 4 Likes

SAS: Telling a Story With Data

SAS, a powerful tool in Consulting and its worldwide application makes it easier to communicate between programmers and clients.

December 17, 2023

by Gautham Mohandas

· 3,211 Views · 2 Likes

Query Federation in Data Virtualization and Best Practices

In this article, I have explained what are the best practices that should be followed in Query Federation in Data Virtualization.

December 17, 2023

by Anandaganesh Balakrishnan

· 4,985 Views · 4 Likes

Shared Platforms Explained: Navigating the Enterprise Ecosystem

Exploring the benefits of shared platforms and best practices from the perspectives of both application and platform owners.

December 15, 2023

by Murat Balkan

CORE

· 6,802 Views · 11 Likes

How To Perform Mixed Computing With Multiple Data Sources

Mixed computing on multiple data sources is an unavoidable problem that needs to be addressed. Read more about strategies to do so.

December 15, 2023

by Buxing Jiang

· 3,347 Views · 2 Likes

Data Governance: MDM and RDM (Part 3)

Master Data Management (MDM) is an essential discipline that helps organizations ensure the consistency, accuracy, and accountability of their shared data assets.

December 15, 2023

by Sukanya Konatam

· 4,857 Views · 2 Likes

ELS+ Stream Tool

ELS+ is an AI-powered analytics tool for businesses to extract valuable insights from their data, improve decision-making, and boost performance.

December 15, 2023

by Sarah Mally

· 4,677 Views · 2 Likes

How To Implement Data Management Into Your AI Strategy

Data is the core of AI strategy: data quality, data integration, and data governance are the three main pillars to best handle the data.

December 14, 2023

by Shivank Shukla

· 4,677 Views · 2 Likes

Designing High Performant Responsive Web Application With AWS Services and Finetuning for Performance

High performant responsive web application due to their ubiquitous nonfunctional requirements pose design challenges with respect to performance engineering

December 14, 2023

by Abhay Patra

· 3,378 Views · 1 Like

Reshaping the Data Engineer’s Experience With Declarative Engineering

Revolutionizing data engineering through declarative engineering by simplifying pipelines and allowing engineers to focus on modeling and optimization.

December 14, 2023

by Andrei Tserakhau

· 4,086 Views · 1 Like

Operational Technology Cybersecurity for Automotive Industry: Learnings From an IBM OT Security Architect

Insights from a senior OT security architect at IBM for developing comprehensive operational security programs in the automotive industry.

December 14, 2023

by Ved Prakash

· 4,729 Views · 1 Like

The Latest Big Data Topics