Big Data Resources

Introduction To Backtesting Strategy: Historical Data Replay in DolphinDB

Import historical data into a stream table in chronological order as “real-time data” so that the same script can be used both for backtesting and real-time trading.

March 1, 2024

by Davis Zhou

· 3,604 Views · 1 Like

Securing and Monitoring Your Data Pipeline: Best Practices for Kafka, AWS RDS, Lambda, and API Gateway Integration

Learn how to implement a data pipeline that integrates Apache Kafka with AWS RDS and use AWS Lambda and API Gateway to feed data into a web application.

February 29, 2024

by Vijay Panwar

CORE

· 6,617 Views · 1 Like

The Evolution of Database Architectures: Navigating Big Data, Cloud, and AI Integration

The article discusses how database architectures have evolved to handle Big Data, Cloud, and AI, covering RDBMS, NoSQL, and cloud-based solutions.

February 29, 2024

by Pankaj Zanke

· 6,870 Views · 4 Likes

Machine Learning at the Edge: Enabling AI on IoT Devices

Implementing ML on IoT devices demands efficient software engineering. Optimize models, use hardware accelerators, manage resources, and prioritize security for success.

February 29, 2024

by Deep Manishkumar Dave

· 4,249 Views · 1 Like

Mastering Data Preparation for Effective Dashboards

In the era of data-driven decision-making, Dashboards have become indispensable everyday tools for visualizing data insights and trends.

February 27, 2024

by Karthikeyan Ilangovan

· 3,401 Views · 2 Likes

AI Against AI: Harnessing Artificial Intelligence To Detect Deepfakes and Vishing

This article looks at the technologies behind these digital deceptions, their societal implications, and the AI-driven techniques designed to detect them.

February 27, 2024

by venkataramaiah gude

· 3,462 Views · 2 Likes

Data Analytics Trends To Watch in 2024

The article emphasizes the need for organizations to balance innovation and accountability in utilizing data analytics for tangible business results.

February 26, 2024

by Neha Malhotra

· 3,248 Views · 1 Like

Why Tiered Storage for Apache Kafka Is a Big Thing

This blog post explores the architecture, use cases, benefits, and a case study for storing Petabytes of data in the Kafka commit log.

February 26, 2024

by Kai Wähner

CORE

· 2,257 Views · 1 Like

A Financial Anti-Fraud Solution Based on the Apache Doris Data Warehouse

This post will go into detail about how a retail bank builds its fraud risk management platform based on Apache Doris and how it performs.

February 26, 2024

by Shirley H.

· 4,213 Views · 1 Like

Real-Time Operating Systems (RTOS) in Embedded Systems

RTOS are crucial for reliable and predictable embedded systems designed to perform specific tasks efficiently, often in real-time.

February 26, 2024

by Ambuj Nandanwar

· 5,652 Views · 5 Likes

How To Handle Optional Values in SwiftData Predicates

This article will explore some techniques and considerations for handling optional values while building SwiftData predicates.

February 23, 2024

by Fatbobman Xu

· 5,000 Views · 1 Like

CRM Analytics, a Guide to Salesforce Data Integrator

Cloud-based business intelligence (BI) and visualization framework known for Salesforce data integration with external sources and predictive analytics.

February 21, 2024

by Kapil Kumar Sharma

· 4,626 Views · 1 Like

Unlocking Efficiency in Big Data: The Power of Data Deduplication Revealed!

In this article, let's understand why data deduplication is crucial in the context of Big Data and the various methods to achieve deduplication.

February 21, 2024

by Roopa Kushtagi

· 2,747 Views · 1 Like

Empower Software Development With Data Analytics: Enhance Efficiency, Quality, and User Satisfaction

The integration of data analytics tools into software development is not merely a trend but a fundamental shift setting new standard of excellence in software industry.

February 21, 2024

by Manjula Natarajan

· 3,405 Views · 1 Like

Top 5 Trends for Data Streaming With Kafka and Flink in 2024

Top 5 Trends for Data Streaming with Apache Kafka and Flink: data sharing, data contracts, multi-cloud, serverless stream processing, GenAI.

February 19, 2024

by Kai Wähner

CORE

· 4,736 Views · 2 Likes

Managing Data Drift With Apache Kafka® Connect and a Schema Registry

In the below article, learn how to use Karapace, an open-source Apache Kafka® schema registry, to prevent data errors by managing the data model across databases.

February 14, 2024

by Francesco Tisiot

· 3,929 Views · 1 Like

What Is an SDK? Examples, Use Cases, and Characteristics

Learn more about software development kits (SDKs). Explore SDK examples, use cases, and characteristics of a good SDK for more efficient software development.

February 13, 2024

by Jim Bennett

· 4,725 Views · 2 Likes

Why Apache Kafka and Apache Flink Work Well Together to Boost Real-Time Data Analytics

Use Flink and Kafka to create reliable, scalable, low-latency real-time data processing pipelines with fault tolerance and exactly-once processing guarantees.

February 13, 2024

by Gautam Goswami

CORE

· 4,982 Views · 1 Like

SSD vs. HDD: How the Choice of Storage Affects Developer Workflows

As a software developer, your computer's performance can significantly impact your work. Are HDDs or SSDs better for your workflow?

February 13, 2024

by Zac Amos

· 4,242 Views · 1 Like

Recognizing Music Genres With the Raspberry Pi Pico

In this article, we will deploy the TensorFlow Lite model to recognize the music genre from audio clips recorded with the microphone connected to the microcontroller.

February 13, 2024

by Gian Marco Iodice

· 3,798 Views · 2 Likes

The Latest Big Data Topics