Big Data Resources

Time to dive into the settings to configure your loads.

Updated December 21, 2020

by Sudhish koloth

· 8,957 Views · 4 Likes

Dbt makes it possible for data engineers to develop a workflow, write data transformation rules, and deploy the entire data modeling process.

December 21, 2020

by Stefan Thorpe

· 6,601 Views · 2 Likes

Who Is Responsible for Data Quality – IT or Business Teams?

This article presents the idea that IT shouldn't be responsible for data quality alone; it's a task that everyone in the organization should be accountable for.

December 18, 2020

by Muhammed Akheel

· 25,102 Views · 3 Likes

Development of the Open-Source Telegram Bot for MQTT IoT

Experience of development a flexible and an easy-to-configure for your needs open-source MQTT client Telegram bot.

December 17, 2020

by Anatoliy Bezgubenko

· 15,687 Views · 3 Likes

Coupling Schema Registry (Confluent) With Multi-Broker Apache Kafka Cluster

We will explain the steps to coupling Confluent Schema Registry with existed/operational multi-broker Apache Kafka cluster(Local deployment).

December 15, 2020

by Gautam Goswami

CORE

· 5,237 Views · 1 Like

In-house Tool for Performance Testing

This article analyzes a way to create a simple tool, which can serve data conditioning testing or performance testing of mobile, web, or desktop applications.

December 14, 2020

by Sudhish koloth

· 5,670 Views · 3 Likes

Strategies for Improving the Performance of Applications Using EF Core

In this article, take a look at some strategies for improving the performance of applications using EF Core.

December 10, 2020

by Joydip Kanjilal

CORE

· 6,438 Views · 3 Likes

How to Keep Elasticsearch in Sync with Relational Databases?

Hibernate Search is a library that allows keeping your local Lucene indexes or ElasticSearch cluster in sync with your database

December 8, 2020

by Hüseyin Akdoğan

CORE

· 9,571 Views · 3 Likes

'mapPartitions' in Apache Spark: 5 Key Benefits

'mapPartitions' is a powerful transformation giving Spark programmers the flexibility to process partitions as a whole by writing custom logic on lines of single-threaded programming. This article highlights the 5 key benefits of 'mapPartitions'.

December 8, 2020

by Ajay Gupta

· 9,807 Views · 1 Like

Implementing Locks in a Distributed Environment

Getting started with lock implementation in a distributed environment, using services such as Kafka, Cassandra, Transformer, and Rules Engine.

December 7, 2020

by Prasanth Gullapalli

· 11,821 Views · 16 Likes

Install and Configuration of Apache Hive-3.1.2 on Multi-Node

The Apache Hive is a data warehouse system built on top of the Apache Hadoop. Hive can be utilized for easy data summarization, and more!

December 2, 2020

by Gautam Goswami

CORE

· 16,654 Views · 2 Likes

Debezium Serialization With Apache Avro and Apicurio Service Registry

This article demonstrates how to use Debezium to monitor a MySQL database and then use Apache Avro with the Apicurio service registry to externalize the data schema and reduce the payload of each one of the captured events.

December 1, 2020

by Hugo Guerrero

CORE

· 6,831 Views · 2 Likes

Setup Zookeeper Cluster – A Minute Chore

Apache Zookeeper’s functionalities are not legitimately noticeable to end-client however it remains as the spine for hyped components like Hadoop to oversee.

November 24, 2020

by Gautam Goswami

CORE

· 10,688 Views · 3 Likes

AI/ML Project Work By Using Scrum

How to apply scrum methodology to work with AI/ML product development. We go over the challenges and tips for application.

November 24, 2020

by CHANDAN LAL PATARY

· 14,752 Views · 3 Likes

Microsoft Azure Data Lake

In this article, see how a team created a central controlled data repository with the MS Azure echo system.

Updated November 19, 2020

by Zeeshan Anwar

· 11,006 Views · 8 Likes

What Is MLOps and What Does Big Data Have To Do With It?

By analogy with DevOps and DataOps, and the growth of their practical implications, the business needs to organize continuous cooperation between participants.

November 18, 2020

by Shahmeer Khan

· 8,257 Views · 3 Likes