Big Data Resources

Coalesce With Care

In Spark, there are two common transformations to change the number of tasks; coalesce and repartition. They are very similar but not identical. Let's see how.

January 19, 2022

by Avi Yehuda

· 4,292 Views · 3 Likes

How To Use SingleStore Pipelines With Kafka, Part 3 of 3

This series of articles looks at the SingleStore feature called Pipelines. Today, learn how to replace the Consumer part of a Producer-Consumer with a SingleStore Pipeline.

January 19, 2022

by Akmal Chaudhri

CORE

· 4,071 Views · 4 Likes

How Does Fabric Solve the Challenges of Data Silos?

One of the major issues solved by fabric is the uncertain volume of incoming data from multiple sources in silos. Read more about the benefits in this post.

January 19, 2022

by Ian Tick

· 4,857 Views · 3 Likes

Querying SQL Databases With PySpark

In this article, we'll learn about how to combine Postgres, PySpark, and Arctype to create powerful visualizations and queries on large data sets.

January 17, 2022

by Everett Berry

· 4,631 Views · 2 Likes

Parsing Data With Just SQL

Simple SQL operations like LOAD, ALTER, INSERT, and UPDATE can turn parsing data from a chore into an efficient and mistake-free task.

January 16, 2022

by Everett Berry

· 3,348 Views · 2 Likes

ClickHouse or StarRocks? Here is a Detailed Comparison

While StarRocks and ClickHouse have a lot in common, there are also differences in functions, performance, and application scenarios. Check out this breakdown of both!

Updated January 16, 2022

by tianyi wang

· 11,033 Views · 6 Likes

Python Bags the TIOBE Language of the Year 2021 in a Row

Python and C# contested to grab the covetous TIOBE programming language of the year award. Python won the competition for its simplicity, extensive libraries, and more

January 16, 2022

by Anemarie Hudson

· 3,880 Views · 3 Likes

Internet of Behavior (IoB): Is It the Future of Customer Experience?

The Internet of Behavior (IoB) is a world-changing technology that has the potential to influence customer experience. Here’s everything you need to know about IoB.

January 14, 2022

by Rodolfo Davis

· 22,447 Views · 5 Likes

Is Go Better Than Python For Data Mining?

Let's compare Go and Python to see how they fit different applications of data mining and what it is that has people divided over which one is better.

Updated January 14, 2022

by Martin Ostrovsky

· 5,626 Views · 4 Likes

Major Technologies That Are Powering the Metaverse

In this blog, discover the latest technologies that are powering the metaverse — a 3D digital world brought to life by several new and interactive technologies.

January 14, 2022

by Piyush Agrawal

· 5,929 Views · 4 Likes

5 Best Applications of Data Science in E-Commerce

Here is a list of the five best applications of data science in e-commerce that major companies are currently using to gain a competitive advantage.

January 14, 2022

by Joydeep Bhattacharya

CORE

· 5,551 Views · 4 Likes

Proxies, Gateways, and Meshes: Next Generation Cloud Connectivity

API gateway admits. Service mesh connects. Kafka streams.

January 14, 2022

by Vik Gamov

· 7,124 Views · 4 Likes

How To Use SingleStore Pipelines With Kafka, Part 2 of 3

This series of articles looks at a compelling feature of SingleStore called Pipelines. Here in Part 2, learn about Producer-Consumer using Java and JDBC.

January 13, 2022

by Akmal Chaudhri

CORE

· 4,038 Views · 4 Likes

Intelligent Data as a Service (iDaaS) - Common Architectural Elements

In the previous article from this series we introduced an architecture around intelligent data as a service (iDaaS) for the healthcare industry. The process ...

January 13, 2022

by Eric D. Schabell

CORE

· 3,592 Views · 3 Likes

The Case for Open Source IoT

A desire to “own” the IoT stack is the greatest threat to the mass adoption of the IoT. Explore three main drivers that prompt the argument for open source IoT.

January 12, 2022

by Kevin Martin

· 21,830 Views · 3 Likes

Speed up Large-Scale ML/DL Offline Inference Jobs at Microsoft Bing

In this article, we will share our observations and the practice to solve the challenges while running inference at scale.

January 11, 2022

by Binyang Li

· 3,487 Views · 3 Likes

Streaming Data Exchange With Kafka and a Data Mesh in Motion

Data Mesh is an architecture paradigm, not a single technology. This post looks into this principle to explore why no single technology is fit to build a Data Mesh.

January 10, 2022

by Kai Wähner

CORE

· 4,851 Views · 7 Likes

Import Data From Hadoop Into CockroachDB

In this article, we are going to take a slight detour from docker compose and evaluate ingestion of data from Hadoop into CockroachDB.

January 7, 2022

by Artem Ervits

CORE

· 5,362 Views · 3 Likes

How To Use SingleStore Pipelines With Kafka, Part 1 of 3

This series of articles looks at a compelling feature of SingleStore called Pipelines. Here in Part 1, learn how to load some sensor data into SingleStore.

January 6, 2022

by Akmal Chaudhri

CORE

· 5,549 Views · 4 Likes

Demystifying Grids For Developers and Designers

UX/UI trends come and go - but one constant, and constantly overlooked, aspect of design optics today are data grids. Let's discuss why is that so?

January 6, 2022

by Sara Faatz

· 9,693 Views · 3 Likes

The Latest Big Data Topics