Over a million developers have joined DZone.

A Trick to Make Your Big Dataviz Load Super Fast

Here is a cool trick to make graphs show up very fast and to work with really large dataset. Hint: show an image as a cache.

· Big Data Zone

Learn how you can maximize big data in the cloud with Apache Hadoop. Download this eBook now. Brought to you in partnership with Hortonworks.

Big datasets are fun. The bigger, the better, especially when you let people explore them live in their browser. But there’s a catch: big datasets are slow to load. Even with modern content delivery networks (CDNs), gzip compression, and high internet speeds, it can take a few seconds to load and parse a dataset. In my H1B salaries visualization, downloading data takes 1.7 seconds, parsing takes another 2 seconds, and rendering takes maybe a full second because some things are done stupidly. That’s a full 4 to 5 seconds before a user sees anything more than a "Loading, please wait” message. Users are going to leave before they play with your dataset. Yes, even though it’s so cool and the data is amazing and awesome, users don’t give a shit. It’s sad. ️

But there’s a trick to keep them around → show them an image first!

Check this out:

See how you barely notice the page refresh? That’s on purpose.

The main App.render() method is wrapped in a conditional statement that checks if the data is available. If it is, then we render the interactive visualization; if it isn’t, then we render a screenshot and default descriptions.

// src/App.js

render() {
    if (this.state.techSalaries.length < 1) {
        return (
            <Preloader />

    // render the main dataviz

The Preloader component can be a functional stateless component, like this:

// src/App.js

import StaticViz from './preloading.png';

const Preloader = () => (
    <div className="App container">
        <h1>The average H1B in tech pays $86,164/year</h1>
        <p className="lead">Since 2012 the US tech industry has sponsored 176,075 H1B work visas. Most of them paid <b>$60,660 to $111,668</b> per year (1 standard deviation). <span>The best city for an H1B is <b>Kirkland, WA</b> with an average individual salary <b>$39,465 above local household median</b>. Median household salary is a good proxy for cost of living in an area.</span></p>
        <img src={StaticViz} style={{width: '100%'}} />
        <h2 className="text-center">Loading data ...</h2>

The Preloader component mimics the structure of your normal dataviz, but it’s hardcoded. The information is real, and it’s what people are looking for, but it doesn’t need the dataset to render.

The easiest way to get this is to first build your real dataviz, then screenshot the picture, and then copy-paste the descriptions if they’re dynamic. Without dynamic descriptions, half your job is done already.

That’s about it, really: 

  1. render an image
  2. wait for data to load
  3. replace image with dynamic dataviz

It sounds dumb, but increases user satisfaction 341324%.

If it works …

Hortonworks DataFlow is an integrated platform that makes data ingestion fast, easy, and secure. Download the white paper now.  Brought to you in partnership with Hortonworks

visualization ,functional ,datasets ,big data

Published at DZone with permission of Swizec Teller, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

The best of DZone straight to your inbox.

Please provide a valid email address.

Thanks for subscribing!

Awesome! Check your inbox to verify your email so you can start receiving the latest in tech news and resources.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}