Big Data Resources

Preventing and Fixing Bad Data in Event Streams (Part 1)

In this blog, we’ll take a look at how bad data may come to be, and how we can deal with it when it comes to event streams.

May 28, 2024

by Adam Bellemare

· 4,483 Views · 3 Likes

ARM CPU for Cost-Effective Apache Kafka at the Edge and Cloud

Learn about ARM CPU for cost-effective and energy-efficient data streaming with Apache Kafka at the Edge and in the Cloud, including use cases.

May 27, 2024

by Kai Wähner

CORE

· 2,989 Views · 1 Like

Bridging the Gap: Exploring Innovative Paths in Data Integration

This article solely focuses on delving into understanding data integrations, associated challenges, emerging technologies, and advanced methodologies.

May 27, 2024

by Yash Mehta

· 1,389 Views · 1 Like

Apache Doris for Log and Time Series Data Analysis

NetEase has replaced Elasticsearch and InfluxDB with Apache Doris, achieving 11X query performance and saving 70% of resources.

May 25, 2024

by Shirley H.

· 2,156 Views · 1 Like

Capturing Acknowledgement in Kafka Streaming With RecordMetadata

In this article, explore RecordMetadata, and its attributes, and discover how it can be leveraged using various use cases.

May 24, 2024

by Raja Chattopadhyay

· 4,295 Views · 2 Likes

Useful Tips and Tricks for Data Scientists

In this article, I will share some of the tricks and tools that I am using to interpret the data in a fast and precise way and get useful insights from it.

May 22, 2024

by Pavel Perfilov

· 5,917 Views · 35 Likes

Cost Optimization Strategies for High-Volume Data Platforms

Managing costs in running a Big Data Platform can be very challenging. This article talks through various strategies to optimize cost at every layer of the platform.

May 22, 2024

by Mayank Singhi

· 2,440 Views · 2 Likes

A Beginner’s Guide to Snowflake Architecture

Snowflake is a cloud-based data warehousing solution that targets removing the nightmares associated with business data storage, management, and analytics.

May 22, 2024

by Saigurudatta Pamulaparthyvenkata

· 3,464 Views · 3 Likes

Using Primary, Partition, and Clustering Keys in ScyllaDB (or Cassandra)

Learn core data modeling concepts that are critical for optimizing performance in wide-column NoSQL databases.

May 20, 2024

by Guy Shtub

· 2,531 Views · 1 Like

10 Svelte Data Grids: Choose the Right One for Your Project

Explore these tips on how to choose the perfect data grid that can be seamlessly integrated into your next Svelte-based project.

May 20, 2024

by Alena Stasevich

· 6,335 Views · 3 Likes

GenAI Demo With Kafka, Flink, LangChain and OpenAI

Explore the architecture and demo for open-source data streaming using Apache Kafka and Flink with Python, LangChain, and OpenAI LLM APIs in the cloud.

May 17, 2024

by Kai Wähner

CORE

· 3,600 Views · 1 Like

Data Science: A Deep Dive Into Careers and Future Scope

Data science is a booming field with diverse career options. It involves analyzing data to uncover insights and requires both technical and soft skills.

May 16, 2024

by Manas Sadangi

· 3,078 Views · 1 Like

Comparing Pandas, Polars, and PySpark: A Benchmark Analysis

Compare different datasets of three tools - Pandas, Polars, and PySpark - with a conclusion about where the future of data processing is going.

May 16, 2024

by Nacho Corcuera

· 10,698 Views · 2 Likes

DevOps vs. DataOps vs. MLOps vs. AIOps: Comparison of All "Ops"

The acronym "Ops" has rapidly increased in IT operations in recent years. Explore different "Ops" in this explanation of DevOps, DataOps, MLOps, and AIOps.

May 16, 2024

by Ravi Kiran Mallidi

CORE

· 9,096 Views · 6 Likes

10 ChatGPT Prompts To Boost Developer Productivity

In this article, we’ll explore 10 ChatGPT prompts tailored specifically for developers and engineers to boost their productivity and streamline their workflow.

May 15, 2024

by Shahid Shaikh

· 5,830 Views · 12 Likes

The Beginner's Guide To Understanding Graph Databases

Explore how graph databases manage complex data through nodes and edges, uses in social networks, fraud detection, and advantages over relational databases.

May 14, 2024

by Shantanu Kumar

CORE

· 7,192 Views · 12 Likes

Leveraging Apache Airflow on AWS EKS (Part 3): Advanced Topics and Practical Use Cases

In part three of this series, take an in-depth look at Apache Airflow, including advanced topics and practical use cases.

May 14, 2024

by Karthik Rajashekaran

CORE

· 2,101 Views · 2 Likes

How To Integrate ChatGPT (OpenAI) With Kubernetes

The combination of Kubernetes' advanced container orchestration capabilities and ChatGPT's contextual language generation enhances workflow efficiency.

May 13, 2024

by Anthony Neto

· 2,578 Views · 1 Like

How To Optimize the Salesforce CRM Analytics Dashboards Using SAQL

Explore Salesforce Analytics Query Language (SAQL), known for facilitating CRM data exploration, transformation, and analysis.

May 10, 2024

by Kapil Kumar Sharma

· 4,677 Views · 2 Likes

Externalize CloudHub Logs to ELK

Log Externalization is a process to send logs to third-party systems which provides more flexibility to prepare various custom dashboards and visualizations.

May 9, 2024

by kashyap kapadia

· 1,915 Views · 1 Like

The Latest Big Data Topics