Big Data Resources

Pure Storage Unveils Groundbreaking Innovations in AI, Automation, and Cyber Resilience at Accelerate 2024

Pure Storage announces next-gen storage automation, AI-powered management, and advanced cyber resilience solutions at Accelerate 2024 to make storage simpler.

June 26, 2024

by Tom Smith

CORE

· 9,889 Views · 1 Like

What Is ELT?

Learn about ELT (Extract, Load, Transform), a modern data management approach that loads raw data into cloud systems for scalable, real-time transformation and analytics.

June 25, 2024

by Suhas Jangoan

· 9,146 Views · 3 Likes

When Not To Use Apache Kafka (Lightboard Video)

When not to use Apache Kafka, do's and don't's; no matter if you use open source, Confluent, Amazon MSK, Event Hubs, Redpanda, Warpstream, et al.

June 25, 2024

by Kai Wähner

CORE

· 2,967 Views · 1 Like

Advanced SQL for Data Engineering

Advanced SQL is a powerful tool that allows you to retrieve, analyze, and manipulate large amounts of data in a structured and efficient way.

June 25, 2024

by Harsh Daiya

CORE

· 7,676 Views · 7 Likes

Optimizing InfiniBand Bandwidth Utilization for NVIDIA DGX Systems Using Software RAID Solutions

Leveraging SPDK vhost-blk with software RAID on NVIDIA DGX systems significantly improves InfiniBand bandwidth utilization and performance.

June 24, 2024

by Sergey Platonov

· 2,741 Views · 1 Like

MaxLinear Empowers High-Speed Connectivity and Data Acceleration Solutions for Next-Gen Computing

Advanced connectivity solutions and Panther III storage accelerator empower software engineers to build high-performance, data-driven computing systems.

June 22, 2024

by Tom Smith

CORE

· 3,954 Views · 1 Like

Embracing NoSQL: The Future of Data Storage and Retrieval

NoSQL databases handle unstructured data, provide scalability, and offer high availability, ideal for modern, big data, and real-time applications.

June 21, 2024

by Lalithkumar Prakashchand

· 4,601 Views · 4 Likes

IoT Needs To Get Serious About Security

Security issues in IoT have gotten worse, not better, and it's time we acknowledge that and fix it. It's long past time.

June 20, 2024

by David G. Simmons

CORE

· 8,344 Views · 4 Likes

Unleashing the Power of Cloud Storage With JuiceFS

JuiceFS, a cloud-native file system, empowers enterprises with scalable, high-performance storage for data-intensive AI and analytics workloads.

June 20, 2024

by Tom Smith

CORE

· 4,561 Views · 2 Likes

Harnessing Kafka Streams for Seamless Data Tasks

Learn about the use of Kafka for convenient data exploration and dynamic data integration with its "publish-subscribe" model, organizing data into topics.

June 18, 2024

by Ilia Ivankin

· 4,916 Views · 2 Likes

Another Lifesaver for Data Engineers: Apache Doris Job Scheduler for Task Automation

The built-in Doris Job Scheduler triggers pre-defined operations efficiently and reliably. It is useful in many cases including ETL and data lake analytics.

June 17, 2024

by Shirley H.

· 1,988 Views · 1 Like

Build an ELT Pipeline From MySQL Database

Easily set up MySQL Change Data Capture using open-source Airbyte and Debezium to construct a near real-time ELT pipeline.

June 17, 2024

by Thalia Barrera

· 3,371 Views · 2 Likes

The Past, Present, and Future of Stream Processing

Stream Processing Journey with IBM, Apama, TIBCO StreamBase, Kafka Streams, Apache Flink, Streaming Databases, GenAI, and Apache Iceberg.

June 17, 2024

by Kai Wähner

CORE

· 9,285 Views · 7 Likes

Explore the Complete Guide to Various Internet of Things (IoT) Protocols

As the IoT industry continues to evolve, it brings about revolutionary changes in device communication, further underscoring the importance of IoT protocols.

June 17, 2024

by BINU SUDHAKARAN PILLAI

· 12,285 Views · 5 Likes

Custom Health Checks in Spring Boot

Spring Boot provides health indicators to monitor application health and database health with the help of Spring Boot Actuator.

June 16, 2024

by Sai Krishna Reddy Chityala

· 14,860 Views · 5 Likes

How Sigma Is Empowering Devs, Engineers, and Architects With Cloud-Native Analytics

Sigma CEO Mike Palmer reveals how the company's cloud-native platform is transforming data analytics for developers, engineers, and architects.

June 13, 2024

by Tom Smith

CORE

· 4,904 Views · 1 Like

Why Use Rust Over C++ for IoT Solution Development

Rust is becoming popular for IoT development due to its superior security, efficient memory management, and modern syntax, overtaking C++.

June 12, 2024

by Den Smyrnov

· 5,046 Views · 1 Like

How Snowflake Is Powering the Future of Big Data With Apache Iceberg and Polaris

Snowflake's Ron Ortloff reveals how the data cloud company is accelerating big data analytics with Apache Iceberg and the new Polaris cloud service.

June 12, 2024

by Tom Smith

CORE

· 3,339 Views · 1 Like

KNIME’s Path To Empowering Developers in the Evolving Data Science Landscape

Michael Berthold, Founder and CEO of KNIME, shares insights on the company's evolution, addressing current data science challenges, and empowering developers.

June 11, 2024

by Tom Smith

CORE

· 1,651 Views · 1 Like

Exploring the Dynamics of Streaming Databases

This article explores what a streaming database is, as it is the core component of a stream processing system, and describes some available solutions.

June 11, 2024

by Federico Trotta

· 5,817 Views · 3 Likes

The Latest Big Data Topics