Big Data Resources

Quality Assurance 101 for AI and Machine Learning

QA for AI and ML is developing fast. Learn why it matters and what data quality has to do with the accuracy of your ML models and the success of AI initiatives.

April 7, 2021

by Aleksei Chumagin

· 6,821 Views · 3 Likes

AI-First Strategy: Where To Start?

Artificial intelligence can give your business a competitive advantage and unlock tremendous opportunities that were hitherto inaccessible. Here’s a 6-step plan to developing an effective AI-first strategy.

April 5, 2021

by Mir Ali

· 7,711 Views · 5 Likes

Spring Cloud Stream Binding Kafka With EmbeddedKafkaRule Using In Tests

Spring Cloud Stream is a framework built on top of Spring Boot and Spring Integration that helps in creating event-driven or message-driven microservices.

March 31, 2021

by Vitaly Kuznetsov (Ippolitov)

· 10,568 Views · 3 Likes

Is Apache Kafka a Database? The 2021 Update

Kafka is a database, providing ACID guarantees. But, it works differently than other databases and doesn't replace them. It's a complementary tool.

Updated March 31, 2021

by Kai Wähner

CORE

· 65,586 Views · 28 Likes

9 Reasons Why Data Quality and Data Governance Initiatives Fail

A Gartner survey revealed that more than 90% of all data governance initiatives fail. Let’s take a look at some of the most common reasons.

March 25, 2021

by Muhammed Akheel

· 11,512 Views · 5 Likes

How To Use Business Process Management for Orchestration of Micro-Services, People, and Robots

If your DevOps team is planning process automation, here are a few key things to know about the flexibility of BPM engines and how to implement them properly.

March 24, 2021

by Miguel Valdes

· 11,594 Views · 5 Likes

How to Run an Elastic MapReduce Job Using a Custom Jar on Amazon EMR

Learn how to develop an application using Java and the MapReduce framework for Hadoop, then execute that app in Amazon's Elastic MapReduce.

March 22, 2021

by Muhammad Ali Khojaye

· 17,671 Views · 4 Likes

20 Business Intelligence Tools and Use Cases

With more data available, it’s getting more difficult to focus on the information we really need and present it in an actionable way. We list 20 tools to help you focus.

March 21, 2021

by Ekaterina Novoseltseva

· 7,483 Views · 3 Likes

Let's Think Kafka Cluster Without Zookeeper With KIP-500

Right now, Apache Kafka utilizes Apache ZooKeeper to store its metadata. Managing a ZooKeeper cluster creates an additional burden on the infrastructure and the admins.

March 19, 2021

by Siva Prasad Rao Janapati

· 7,093 Views · 3 Likes

How to Efficiently Choose the Right Database for Your Applications

Finding the right database solution for your application is not easy. Learn how to efficiently find a database for your applications.

March 19, 2021

by Guo Leitao

· 7,937 Views · 2 Likes

How Checksum Smartly Manages Data Integrity in HDFS

In two words, data integrity can be defined as an assurance of the accuracy and consistency of data throughout the entire life cycle.

March 16, 2021

by Gautam Goswami

CORE

· 6,797 Views · 2 Likes

Why Java Is so Young After 25 Years: An Architect’s Point of View

Java completes 25 years of programming life and remains closer to developer's minds; almost 69% of the worldwide developer community remains to code in Java, even now.

Updated March 16, 2021

by Dr.Magesh Kasthuri

· 17,585 Views · 16 Likes

Health Monitoring Through Data From Wearables

Wearable IoT devices for health monitoring are presented. Opportunities and challenges for developing applications for interoperable big data are also explored.

March 16, 2021

by Thiago Nascimento

CORE

· 18,684 Views · 2 Likes

Run and Scale an Apache Spark Application on Kubernetes

Learn how to set up Apache Spark on IBM Cloud Kubernetes Service by pushing the Spark container images to IBM Cloud Container Registry....

March 15, 2021

by Vidyasagar (Sarath Chandra) Machupalli FBCS

CORE

· 9,617 Views · 5 Likes

Using Machine Learning to Automate Data Cleansing

There are stages in the data cleansing process where machine learning can not only automate workflows, but influence decisions, and achieve better results.

March 8, 2021

by Zara Ziad

· 10,574 Views · 4 Likes

Apache Kafka in a Smart City Architecture

Event streaming with Apache Kafka fits into smart city architecture for data integration and correlation in real-time, at scale, between stakeholders.

March 5, 2021

by Kai Wähner

CORE

· 32,356 Views · 13 Likes

Data Integration and ETL for Dummies (Like Me)

How to understand modern data integration and ETL from a non-technical perspective.

March 4, 2021

by David Molot

· 16,657 Views · 16 Likes

The Basics of Embedded Systems and the Internet of Things

Introduction to the elements of embedded system architectures across a wide variety of embedded applications, exploring the relationship between embedded systems and IoT.

March 3, 2021

by Jim Ledin

· 23,771 Views · 4 Likes

Use Cases for Apache Kafka in Retail

Event streaming with Apache Kafka in the retail industry facilitates real-time omnichannel, Customer 360, inventory management, recommendations, and more.

March 2, 2021

by Kai Wähner

CORE

· 7,586 Views · 9 Likes

Apache Camel Integration with Kafka

This article covers the integration of Apache Camel with Kafka, from setup to testing, with code blocks and plenty of pictures!

February 28, 2021

by Vignesh Prabhu

· 16,742 Views · 1 Like

The Latest Big Data Topics