Big Data Resources

Petastorm: A Simple Approach to Deep Learning Models in Apache Parquet Format

Learn how to generate a Petastorm dataset that is compatible with different machine learning frameworks, analyze and manipulate the dataset, and more.

January 14, 2021

by Dr. Michael Garbade

· 5,458 Views · 22 Likes

SQL vs NoSQL and SQL to NoSQL Migration

In this article, see a comparison of relational and NoSQL databases and also look at RDBMS to NoSQL migration options.

Updated January 14, 2021

by Sandeep Tol

· 29,254 Views · 11 Likes

Dynamic SQL Injection With Oracle ERP Cloud

This article covers the steps to create a Dynamic BI Report so SQL can be injected at a run time to the report, which can be useful in building integrations.

January 11, 2021

by Puneet Kakkar

· 8,120 Views · 4 Likes

How Java Language Is Best for IoT Systems Development

A quick analytical rundown of the Internet of Things, why Java is so useful for IoT system development, and the benefits of using Java in your IoT system developments.

January 1, 2021

by Manpreet Singh

· 6,753 Views · 1 Like

Grafana and Prometheus Setup With Strimzi, a.k.a. Kafka on Kubernetes.

A software developer gives a quick tutorial on how to use Strimzi to integrate Prometheus into a Java-based application. Read on to learn more!

December 31, 2020

by Chandra Shekhar Pandey

· 20,219 Views · 2 Likes

Which AWS Storage Solution Is Right for Your Elasticsearch Cluster?

There are way too many storage options on AWS. Let's see which one is best for your Elasticsearch cluster.

December 31, 2020

by Chris Cooney

· 9,354 Views · 4 Likes

Throttling Made Easy: Back Pressure in Akka Streams

Learn how to use Akka Streams as a built-in protocol to attain overflow and underflow in fast data systems.

December 30, 2020

by Jay Reddy

· 9,156 Views · 2 Likes

Top 15 Software Testing Trends to Watch Out in 2021

List of Top 15 Software Testing Trends in 2021. These trends bring a huge transition in a QA tester's life and indeed mould the future of Software Testing.

December 28, 2020

by Shormistha Chatterjee

CORE

· 17,936 Views · 5 Likes

Embracing NewSQL: Why We Chose TiDB Over MongoDB and MySQL

PalFish explains why they chose TiDB over MongoDB and MySQL. The key factors were their application requirements and their perspective on NewSQL databases.

December 24, 2020

by kylin chen

· 20,273 Views · 2 Likes

A Gentle (and Practical) Introduction to Apache Avro (Part 1)

Time to get your feet wet with Avro.

December 22, 2020

by Anton Rodriguez

· 10,409 Views · 7 Likes

Throttle Spark-Kafka Streaming Volume

Time to dive into the settings to configure your loads.

Updated December 21, 2020

by Sudhish koloth

· 8,931 Views · 4 Likes

Optimizing dbt and Google’s BigQuery

Dbt makes it possible for data engineers to develop a workflow, write data transformation rules, and deploy the entire data modeling process.

December 21, 2020

by Stefan Thorpe

· 6,575 Views · 2 Likes

Who Is Responsible for Data Quality – IT or Business Teams?

This article presents the idea that IT shouldn't be responsible for data quality alone; it's a task that everyone in the organization should be accountable for.

December 18, 2020

by Muhammed Akheel

· 25,022 Views · 3 Likes

Development of the Open-Source Telegram Bot for MQTT IoT

Experience of development a flexible and an easy-to-configure for your needs open-source MQTT client Telegram bot.

December 17, 2020

by Anatoliy Bezgubenko

· 15,621 Views · 3 Likes

Coupling Schema Registry (Confluent) With Multi-Broker Apache Kafka Cluster

We will explain the steps to coupling Confluent Schema Registry with existed/operational multi-broker Apache Kafka cluster(Local deployment).

December 15, 2020

by Gautam Goswami

CORE

· 5,201 Views · 1 Like

In-house Tool for Performance Testing

This article analyzes a way to create a simple tool, which can serve data conditioning testing or performance testing of mobile, web, or desktop applications.

December 14, 2020

by Sudhish koloth

· 5,646 Views · 3 Likes

Strategies for Improving the Performance of Applications Using EF Core

In this article, take a look at some strategies for improving the performance of applications using EF Core.

December 10, 2020

by Joydip Kanjilal

CORE

· 6,369 Views · 3 Likes

How to Keep Elasticsearch in Sync with Relational Databases?

Hibernate Search is a library that allows keeping your local Lucene indexes or ElasticSearch cluster in sync with your database

December 8, 2020

by Hüseyin Akdoğan

CORE

· 9,553 Views · 3 Likes

'mapPartitions' in Apache Spark: 5 Key Benefits

'mapPartitions' is a powerful transformation giving Spark programmers the flexibility to process partitions as a whole by writing custom logic on lines of single-threaded programming. This article highlights the 5 key benefits of 'mapPartitions'.

December 8, 2020

by Ajay Gupta

· 9,673 Views · 1 Like

Implementing Locks in a Distributed Environment

Getting started with lock implementation in a distributed environment, using services such as Kafka, Cassandra, Transformer, and Rules Engine.

December 7, 2020

by Prasanth Gullapalli

· 11,745 Views · 16 Likes

The Latest Big Data Topics