Big Data Resources

Apache Iceberg Table Management is essential to ensure smooth table operations by expiring/deleting unused data, metadata files.

July 30, 2024

by Rohit Kumar

· 2,499 Views · 1 Like

Real-Time Streaming Architectures: A Technical Deep Dive Into Kafka, Flink, and Pinot

While individual components like Kafka, Flink, and Pinot are very powerful, managing them at scale across cloud and on-premises deployments can be operationally complex.

July 28, 2024

by Abhishek Gupta

CORE

· 7,682 Views · 4 Likes

Snowflake Integration Patterns: Apache Kafka vs. Zero ETL and Reverse ETL

Integration patterns for cloud-native Snowflake data warehouse: Batch data, Zero ETL, Reverse ETL, Real-time data ingestion with Apache Kafka.

July 24, 2024

by Kai Wähner

CORE

· 5,842 Views · 2 Likes

Step-By-Step Guide To Setting up and Training GANs for Image Generation

Learn to set up and train Generative Adversarial Networks (GANs) using TensorFlow and PyTorch for image generation and manipulation.

July 23, 2024

by Neha Dhaliwal

· 3,575 Views · 2 Likes

Emerging Trends in Data Warehousing: What’s Next?

Explore the latest advances and future trends in data warehousing technologies, highlighting the innovations that are shaping the next generation of data warehouses.

July 23, 2024

by Metin SARIKAYA

· 43,546 Views · 1 Like

Building Your Own IoT Project: A Step-By-Step Guide

This guide will walk you through the essential steps to build your first IoT project, ensuring you have a solid foundation to explore this fascinating field.

July 22, 2024

by Sachin Reddy

· 7,475 Views · 3 Likes

When Not to Choose Google Apache Kafka for BigQuery

When not to choose Google Apache Kafka for BigQuery — a review, comparison with Confluent Cloud, and data streaming landscape outlook.

July 16, 2024

by Kai Wähner

CORE

· 4,754 Views · 1 Like

Alluxio Enterprise AI 3.2: Enhancing GPU Utilization and Data Access for AI Workloads

Alluxio Enterprise AI 3.2 revolutionizes GPU utilization and data access for AI workloads, offering seamless integration and enhanced performance.

July 15, 2024

by Tom Smith

CORE

· 2,793 Views · 1 Like

Factors to Consider: Data Warehouse Modernization

This article will help you with the factors that you will have to consider while choosing the new platform/endpoint, ETL suite, etc., for modernizing your data warehouse.

July 15, 2024

by Madhuri Veluri

· 3,545 Views · 1 Like

An Introduction To Open Table Formats

Path to performant, cost-effective, efficient data lakehouse enabling more intelligent interaction between storage and compute engines.

July 15, 2024

by Kranthi Kiran Erusu

· 4,866 Views · 5 Likes

How To Reduce Memory Consumption in Integration Tests With Kafka Using GraalVM

This article details the process of creating a native image for EmbeddedKafka with GraalVM, highlighting its benefits in integration tests.

July 12, 2024

by Anton Belyaev

· 5,876 Views · 1 Like

Isolation in Testing With Kafka

This article explores simplifying Kafka integration tests by ensuring test isolation and offering tools for better control.

July 11, 2024

by Anton Belyaev

· 4,871 Views · 2 Likes

Mitigate the Security Challenges of Telecom 5G IoT Microservice Pods Architecture Using Istio

Discover the essential features of Istio Service Mesh Architecture and master the configuration of Istio for cellular IoT Microservices pods.

July 9, 2024

by BINU SUDHAKARAN PILLAI

· 8,939 Views · 3 Likes

Mastering the Art of ChatGPT: 15 Prompt Engineering Techniques

Journey through the fascinating world of Prompt Engineering, exploring 15 unique techniques that can transform how you interact with ChatGPT.

July 9, 2024

by Rakesh A Surendra

· 3,794 Views · 1 Like

Pure Storage Empowers Developers and Data Scientists With Agile, High-Performance Storage for AI and Modern Applications

Pure Storage accelerates AI workloads and modern app development with agile, high-performance storage solutions like FlashBlade and Evergreen//One for AI.

July 9, 2024

by Tom Smith

CORE

· 3,116 Views · 1 Like

Next-Gen Lie Detector: Stack Selection

Follow the steps of the creation of a lie detector's backend stack and learn the importance of remaining open to unconventional solutions for common tasks.

July 5, 2024

by Grigorii Novikov

· 58,503 Views · 55 Likes

Pure Storage Empowers Developers, Engineers, and Architects With AI-Driven Storage Innovation

AI-powered storage solutions, enhanced cyber resilience, and cloud integrations are unveiled at Accelerate 2024 to revolutionize enterprise data management.

July 5, 2024

by Tom Smith

CORE

· 4,533 Views · 1 Like

Phased Approach to Data Warehouse Modernization

This article will help you plan the migration of your data warehouse loads into a new database or a cloud-based data warehouse.

July 4, 2024

by Madhuri Veluri

· 6,797 Views · 3 Likes

Data Integration Technology Maturity Curve 2024-2030

When it comes to data integration, some people may wonder what there is to discuss— isn't it just ETL? Learn more in this post.

July 3, 2024

by William Guo

· 6,678 Views · 4 Likes

Pure Storage Tackles AI and HPC Data Challenges With Flexible Storage Solutions

Unveils new AI and HPC data solutions to empower developers, engineers, and architects with faster, more flexible access to data for next-gen applications.

July 3, 2024

by Tom Smith

CORE

· 3,049 Views · 1 Like

The Latest Big Data Topics