Big Data Resources

The Effect of Data Storage Strategy on PostgreSQL Performance

The free and fully open-source version of PostgreSQL is enterprise-ready; here's how to make its performance hum even with read/write-heavy workloads.

June 8, 2023

by Anil Inamdar

· 5,548 Views · 2 Likes

Exploratory Programming: Challenges and Keys to Success

Exploratory Programming (EP) is a dynamic approach in data science that influences how data optimization is conducted and leads to innovative solutions.

June 8, 2023

by Rajeev Bera

· 5,014 Views · 1 Like

Understanding Data Compaction in 3 Minutes

Think of your disks as a warehouse: The compaction mechanism is like a team of storekeepers who help put away the incoming data.

June 6, 2023

by Shirley H.

· 3,438 Views · 1 Like

Decoding ChatGPT: The Concerns We All Should Be Aware Of

OpenAI's ChatGPT has quickly gained popularity and reached 100 million monthly users. However, users must avoid over-reliance on ChatGPT and maintain human judgment.

June 6, 2023

by Vaibhav Ghildiyal

· 3,568 Views · 1 Like

The AI Revolution: Embracing the Future of Technology and Automation

The development and use of intelligent computer systems capable of doing activities that normally require human intelligence is referred to as AI technology.

June 6, 2023

by Rajinder Kumar

· 4,368 Views · 2 Likes

CPU vs. GPU Intensive Applications

Learn about CPU vs. GPU intensive applications and why each is best suited for particular tasks. We explain parallelization, Amdahl’s Law, and how these concepts affect whether to use a CPU, GPU, or both for your application.

June 5, 2023

by Kevin Vu

· 4,306 Views · 2 Likes

Constructing Real-Time Analytics: Fundamental Components and Architectural Framework — Part 2

The fundamental components of real-time analytics are event streaming and a specialized database that can manage large amounts of data in less than a second.

June 2, 2023

by David Wang

· 5,049 Views · 2 Likes

Automating Data Quality Check in Data Pipelines

Are you looking for ways to automate data quality checks in your data pipelines? Here are some helpful tools that can streamline the process for you.

June 2, 2023

by Hardik Shah

· 5,013 Views · 1 Like

10 Effective Strategies To Safeguard Your IoT Network From Threats

The security of IoT networks is a challenge that needs to be addressed at a global scale. This blog will uncover some risks associated with IoT network security.

June 1, 2023

by Kamal R

· 3,650 Views · 1 Like

The State of Data Streaming for Manufacturing

The state of data streaming in the manufacturing industry explores case studies from BMW, Mercedes, Michelin, and Siemens powered by Apache Kafka.

June 1, 2023

by Kai Wähner

CORE

· 2,580 Views · 2 Likes

Knowing and Valuing Apache Kafka’s ISR (In-Sync Replicas)

To get more clarity about ISR in Apache Kafka, we should first carefully examine the replication process in the Kafka broker.

June 1, 2023

by Gautam Goswami

CORE

· 4,560 Views · 1 Like

Replacing Apache Hive, Elasticsearch, and PostgreSQL With Apache Doris

How does a data service company build its data warehouse? Simplicity is the best policy. See how we increased data writing efficiency by 75%.

May 31, 2023

by Twan Wang

· 3,236 Views · 1 Like

Rule-Based Prompts: How To Streamline Error Handling and Boost Team Efficiency With ChatGPT

The art of creating rule-based prompts for ChatGPT is accelerating the development of apps and services for any industry, and in this article, I share how to do it.

May 31, 2023

by Denis Avramenko

· 4,917 Views · 2 Likes

Data Exploration Using Serverless SQL Pool In Azure Synapse

In this detailed article, you will learn how to carry out data ingestion and analysis using Azure Synapse Serverless SQL Pool along with sample datasets.

May 31, 2023

by Mohan Krishna Mangamuri

· 3,401 Views · 1 Like

Machine Learning Driving Innovation in the Digital Age

As machine learning (ML) is revolutionizing an enterprise's digital transformation, the path to successful ML implementation comes with its own set of challenges.

May 30, 2023

by Frederic Jacquet

CORE

· 3,893 Views · 3 Likes

Seven Steps To Deploy Kedro Pipelines on Amazon EMR

In this post, the author explains how to launch an Amazon EMR cluster and how to deploy a Kedro project to run a Spark job.

May 30, 2023

by Jo Stichbury

CORE

· 4,005 Views · 2 Likes

Competing Consumers With Spring Boot and Hazelcast

Follow a simplified demo implementation of the competing Consumers pattern using Java, Spring Boot, and Hazelcast's distributed queue.

May 29, 2023

by Kyriakos Mandalas

CORE

· 9,607 Views · 12 Likes

How To Use Pandas and Matplotlib To Perform EDA In Python

In this article, we will explore how to use two popular Python libraries, Pandas and Matplotlib, to perform EDA.

May 29, 2023

by Stylianos Kampakis

· 7,353 Views · 5 Likes

What to Pay Attention to as Automation Upends the Developer Experience

The developer experience is changing faster than ever. Here's a primer on where things stand right now and what developers can expect.

May 26, 2023

by Shomron Jacob

· 6,031 Views · 2 Likes

What ChatGPT Needs Is Context

Like the calculator, the spreadsheet, and the internet, AI-driven LLM tools are likely to change HOW we do our work, but not the fact that humans will still be the ones doing the work in the first place.

May 26, 2023

by Leon Adato

· 6,114 Views · 3 Likes

The Latest Big Data Topics