Big Data Resources

Use a real-time analytics database to record NFC badge scans in part 1 of this 3-part project involving environmental data, real-time notifications, and more.

April 19, 2023

by David G. Simmons

CORE

· 4,892 Views · 5 Likes

Integrate Apache Spark and QuestDB for Time-Series Analytics

In this tutorial, we will explore how a Spark Application can load and save data from/to QuestDB and provide practical advice to achieve the best performance.

April 19, 2023

by Imre Aranyosi

· 4,284 Views · 8 Likes

Apache Kafka in Java [Video Tutorials]: Architecture and Simple Consumer/Producer

Explore a video tutorial series regarding Apache Kafka in Java as you explore Kafka architecture, components, producer callbacks, and more.

April 19, 2023

by Ram N

· 5,949 Views · 2 Likes

Introduction to Elasticsearch

Elasticsearch is a highly scalable and distributed search and analytics engine designed to handle large volumes of structured, semi-structured, and unstructured data.

April 19, 2023

by Rama Krishna Panguluri

· 13,381 Views · 11 Likes

Apache Kafka for Data Consistency

Apache Kafka ensures data consistency across legacy batch, request-response mobile apps, and real-time streaming in a data mesh architecture.

April 18, 2023

by Kai Wähner

CORE

· 3,453 Views · 2 Likes

Maximizing the Potential of LLMs: A Guide to Prompt Engineering

Carefully designing the prompts used in LLMs like GPT-4 can greatly improve the results and become very useful for a variety of use cases.

April 18, 2023

by Roger Oriol

· 5,210 Views · 1 Like

Demystifying Data Fabric Architecture: A Comprehensive Overview

This article will provide a comprehensive overview of the data fabric architecture, its key components, and how it works.

April 18, 2023

by Amlan Patnaik

· 6,595 Views · 3 Likes

Embedded Systems Security Vulnerabilities and Protection Measures

Some tips and important consideration for embedded devices, which are often connected to the internet and can be vulnerable to various types of cyberattacks.

April 17, 2023

by Sreekanth Yalavarthi

· 5,876 Views · 4 Likes

Securing MQTT With Username and Password Authentication

This article will explain how authentication works in MQTT, what security risks it solves, and introduce password-based authentication.

April 17, 2023

by Kary Ware

· 4,882 Views · 1 Like

Is Apache Kafka Providing Real Message Ordering?

We’re told that Apache Kafka preserves message ordering per topic/partition, but how true is that, and how close can we come to making it true?

April 14, 2023

by Francesco Tisiot

· 8,531 Views · 1 Like

Why ChatGPT Is Not as Intelligent as Many Believe

While this AI tech is impressive, it's wrong to trust and rely on it 100%. What's the problem? I've got four for you to consider.

April 14, 2023

by Olesia Filipenko

· 9,353 Views · 12 Likes

Stocks Notification: TradingView Webhook to Telegram

At the start of the year, I worked on a Telegram bot that sends market data of certain stocks for the previous day's close to a Telegram channel.

April 13, 2023

by Han Chiang

· 3,985 Views · 2 Likes

.NET on AWS – Persisting Application Data to S3 (Part 2)

In part two of this two-part series, we will build a REST API using .NET to perform CRUD operations for application data storage on S3.

April 13, 2023

by Jawad Hasan Shani

CORE

· 4,907 Views · 1 Like

AIPRM Plugin for ChatGPT

AIPRM is an acronym for Artificial Intelligence Powered Relationship Management. AIPRM Plugin is an advanced tool designed to enhance the performance of AI.

April 13, 2023

by sugandha chejara

· 8,383 Views · 1 Like

Integrating Cloud-Based Applications, Kafka Middle-Ware/Data Streams, CRM, and Snowflake Data Warehouse in IT Architecture for Small and Medium Enterprises

This post explores how SMEs can use CRM, AWS, Kafka, and Snowflake data warehouse in their IT architecture to achieve the best solution.

April 13, 2023

by Kiran P

· 5,343 Views · 3 Likes

Eight Reasons ChatGPT Is the Future of Conversational AI

Explore the cutting-edge technology and capabilities of ChatGPT, the language model revolutionizing the way we communicate.

April 13, 2023

by Amy Parker

· 3,957 Views · 2 Likes

The Ultimate API Development Guide: Strategy, Tools, Best Practices

API development accelerates innovation and growth opportunities. Read top API development processes, tools, and practices.

April 12, 2023

by Ishan Gupta

· 5,254 Views · 6 Likes

Using CockroachDB CDC With Apache Pulsar

As of this writing, CockroachDB does not have a direct integration with Apache Pulsar. Here, integrate CockroachDB CDC with Pulsar via the existing Kafka sink.

April 12, 2023

by Artem Ervits

CORE

· 8,980 Views · 3 Likes

Building an Optimized Data Pipeline on Azure Using Spark, Data Factory, Databricks, and Synapse Analytics

This article will explore how Apache Spark, Azure Data Factory, Databricks, and Synapse Analytics can be used together to create an optimized data pipeline in the cloud.

April 11, 2023

by Amlan Patnaik

· 6,432 Views · 3 Likes

.NET on AWS – Persisting Application Data to S3 (Part 1)

In this post, we will create an S3 bucket and .NET solution and configure the wiring between them for application data persistence.

April 11, 2023

by Jawad Hasan Shani

CORE

· 4,120 Views · 1 Like

The Latest Big Data Topics