Big Data Resources

What Is ELT?

Learn about ELT (Extract, Load, Transform), a modern data management approach that loads raw data into cloud systems for scalable, real-time transformation and analytics.

June 25, 2024

by Suhas Jangoan

· 9,251 Views · 3 Likes

When Not To Use Apache Kafka (Lightboard Video)

When not to use Apache Kafka, do's and don't's; no matter if you use open source, Confluent, Amazon MSK, Event Hubs, Redpanda, Warpstream, et al.

June 25, 2024

by Kai Wähner

CORE

· 3,043 Views · 1 Like

Advanced SQL for Data Engineering

Advanced SQL is a powerful tool that allows you to retrieve, analyze, and manipulate large amounts of data in a structured and efficient way.

June 25, 2024

by Harsh Daiya

CORE

· 7,839 Views · 7 Likes

Optimizing InfiniBand Bandwidth Utilization for NVIDIA DGX Systems Using Software RAID Solutions

Leveraging SPDK vhost-blk with software RAID on NVIDIA DGX systems significantly improves InfiniBand bandwidth utilization and performance.

June 24, 2024

by Sergey Platonov

· 2,785 Views · 1 Like

MaxLinear Empowers High-Speed Connectivity and Data Acceleration Solutions for Next-Gen Computing

Advanced connectivity solutions and Panther III storage accelerator empower software engineers to build high-performance, data-driven computing systems.

June 22, 2024

by Tom Smith

CORE

· 4,025 Views · 1 Like

Embracing NoSQL: The Future of Data Storage and Retrieval

NoSQL databases handle unstructured data, provide scalability, and offer high availability, ideal for modern, big data, and real-time applications.

June 21, 2024

by Lalithkumar Prakashchand

· 4,668 Views · 4 Likes

IoT Needs To Get Serious About Security

Security issues in IoT have gotten worse, not better, and it's time we acknowledge that and fix it. It's long past time.

June 20, 2024

by David G. Simmons

CORE

· 8,473 Views · 4 Likes

Unleashing the Power of Cloud Storage With JuiceFS

JuiceFS, a cloud-native file system, empowers enterprises with scalable, high-performance storage for data-intensive AI and analytics workloads.

June 20, 2024

by Tom Smith

CORE

· 4,664 Views · 2 Likes

Harnessing Kafka Streams for Seamless Data Tasks

Learn about the use of Kafka for convenient data exploration and dynamic data integration with its "publish-subscribe" model, organizing data into topics.

June 18, 2024

by Ilia Ivankin

· 4,976 Views · 2 Likes

Another Lifesaver for Data Engineers: Apache Doris Job Scheduler for Task Automation

The built-in Doris Job Scheduler triggers pre-defined operations efficiently and reliably. It is useful in many cases including ETL and data lake analytics.

June 17, 2024

by Shirley H.

· 2,044 Views · 1 Like

Build an ELT Pipeline From MySQL Database

Easily set up MySQL Change Data Capture using open-source Airbyte and Debezium to construct a near real-time ELT pipeline.

June 17, 2024

by Thalia Barrera

· 3,434 Views · 2 Likes

The Past, Present, and Future of Stream Processing

Stream Processing Journey with IBM, Apama, TIBCO StreamBase, Kafka Streams, Apache Flink, Streaming Databases, GenAI, and Apache Iceberg.

June 17, 2024

by Kai Wähner

CORE

· 9,381 Views · 7 Likes

Explore the Complete Guide to Various Internet of Things (IoT) Protocols

As the IoT industry continues to evolve, it brings about revolutionary changes in device communication, further underscoring the importance of IoT protocols.

June 17, 2024

by BINU SUDHAKARAN PILLAI

· 12,381 Views · 5 Likes

Custom Health Checks in Spring Boot

Spring Boot provides health indicators to monitor application health and database health with the help of Spring Boot Actuator.

June 16, 2024

by Sai Krishna Reddy Chityala

· 15,096 Views · 5 Likes

How Sigma Is Empowering Devs, Engineers, and Architects With Cloud-Native Analytics

Sigma CEO Mike Palmer reveals how the company's cloud-native platform is transforming data analytics for developers, engineers, and architects.

June 13, 2024

by Tom Smith

CORE

· 5,038 Views · 1 Like

Why Use Rust Over C++ for IoT Solution Development

Rust is becoming popular for IoT development due to its superior security, efficient memory management, and modern syntax, overtaking C++.

June 12, 2024

by Den Smyrnov

· 5,114 Views · 1 Like

How Snowflake Is Powering the Future of Big Data With Apache Iceberg and Polaris

Snowflake's Ron Ortloff reveals how the data cloud company is accelerating big data analytics with Apache Iceberg and the new Polaris cloud service.

June 12, 2024

by Tom Smith

CORE

· 3,403 Views · 1 Like

KNIME’s Path To Empowering Developers in the Evolving Data Science Landscape

Michael Berthold, Founder and CEO of KNIME, shares insights on the company's evolution, addressing current data science challenges, and empowering developers.

June 11, 2024

by Tom Smith

CORE

· 1,688 Views · 1 Like

Exploring the Dynamics of Streaming Databases

This article explores what a streaming database is, as it is the core component of a stream processing system, and describes some available solutions.

June 11, 2024

by Federico Trotta

· 5,887 Views · 3 Likes

Choosing the Optimal Data Storage Architecture

Explore the differences between a Data Warehouse, Data Lake, and Data Lakehouse architectures to choose the best fit for your business needs.

June 10, 2024

by Den Smyrnov

· 2,615 Views · 1 Like

The Latest Big Data Topics