Big Data Resources

Install and Configuration of Apache Hive-3.1.2 on Multi-Node

The Apache Hive is a data warehouse system built on top of the Apache Hadoop. Hive can be utilized for easy data summarization, and more!

December 2, 2020

by Gautam Goswami

CORE

· 16,624 Views · 2 Likes

Debezium Serialization With Apache Avro and Apicurio Service Registry

This article demonstrates how to use Debezium to monitor a MySQL database and then use Apache Avro with the Apicurio service registry to externalize the data schema and reduce the payload of each one of the captured events.

December 1, 2020

by Hugo Guerrero

CORE

· 6,788 Views · 2 Likes

Setup Zookeeper Cluster – A Minute Chore

Apache Zookeeper’s functionalities are not legitimately noticeable to end-client however it remains as the spine for hyped components like Hadoop to oversee.

November 24, 2020

by Gautam Goswami

CORE

· 10,646 Views · 3 Likes

AI/ML Project Work By Using Scrum

How to apply scrum methodology to work with AI/ML product development. We go over the challenges and tips for application.

November 24, 2020

by CHANDAN LAL PATARY

· 14,714 Views · 3 Likes

Microsoft Azure Data Lake

In this article, see how a team created a central controlled data repository with the MS Azure echo system.

Updated November 19, 2020

by Zeeshan Anwar

· 10,964 Views · 8 Likes

What Is MLOps and What Does Big Data Have To Do With It?

By analogy with DevOps and DataOps, and the growth of their practical implications, the business needs to organize continuous cooperation between participants.

November 18, 2020

by Shahmeer Khan

· 8,230 Views · 3 Likes

Best Practices for Enterprise Data Warehouse Governance

Valuable insights can only be generated when the data warehouse successfully integrates data from multiple sources for reporting and analysis.

November 18, 2020

by Stefan Thorpe

· 7,019 Views · 2 Likes

4 Common Reasons for FetchFailed Exception in Apache Spark

This article lists out the most common four reasons for a FetchFailed exception in Apache Spark.

November 17, 2020

by Ajay Gupta

· 34,112 Views · 3 Likes

Implementing MongoDB to Elastic Search 7.X Data Pipeline

In this article, we will see how to implement a data pipeline from an application to Mongo DB database and from there into an Elastic Search.

November 16, 2020

by Swarnava Chakraborty

· 10,299 Views · 2 Likes

Cloud-Events Kafka Binding With Spring

Utilize Kafka Protocol Binding for CloudEvents along with Spring-Kafka to easily produce and consume events in a common format.

November 13, 2020

by Will Kennedy

· 13,312 Views · 7 Likes

Connected Car: Challenges and Opportunities for the Automotive Industry

In this article, take a look at the challenges and opportunities for the automative industry when it comes to connected car technology.

November 13, 2020

by Marcin Wisniewski

· 17,370 Views · 3 Likes

Importance of Schema Registry on Kafka Based Data Streaming Pipelines

Schema Registry acts as a service layer for metadata. It stores a versioned history of all the schema of registered data streams and schema change history.

November 11, 2020

by Gautam Goswami

CORE

· 7,171 Views · 2 Likes

Product Manager: Machine Learning Interview Questions

In this post, you will learn about some of the interview questions that can be asked in the product manager/business analyst job.

November 11, 2020

by Ajitesh Kumar

· 13,903 Views · 4 Likes

Change Data Capture From PostgreSQL to Azure Data Explorer Using Kafka Connect

In this article, look at change data capture from PostgreSQL to Azure Data Explorer using Kafka Connect.

November 4, 2020

by Abhishek Gupta

CORE

· 7,721 Views · 4 Likes

Kafka Monitoring via Prometheus-Grafana

In this article, take a look at Kafka monitoring via Prometheus-Grfana.

November 4, 2020

by Murat Derman

· 36,399 Views · 4 Likes

Pulsar vs Kafka — Comparison and Myths Explored

Pros and cons, popular myths, and non-technical criteria of both Open Source Frameworks

Updated November 4, 2020

by Kai Wähner

CORE

· 13,968 Views · 8 Likes

Ports and Adapters Architecture with Kafka, Avro, and Spring-Boot

In this post, we will be implementing a Kafka Producer and Consumer using the Ports and Adapters (a.k.a. Hexagonal) architecture in a multi-module Maven project.

November 3, 2020

by Purnima Jain

· 13,154 Views · 4 Likes