Over a million developers have joined DZone.

Today's Real-Time Data, Tomorrow's Forgotten Dream

DZone's Guide to

Today's Real-Time Data, Tomorrow's Forgotten Dream

· Big Data Zone ·
Free Resource

The open source HPCC Systems platform is a proven, easy to use solution for managing data at scale. Visit our Easy Guide to learn more about this completely free platform, test drive some code in the online Playground, and get started today.

David Bowie releases his new album, The Next Day, recently. I’ve not had a chance to listen to it yet but the title itself was provocative enough for this post.

The disciplines of Big Data and real-time predictive analytics present organizations with the ability to understand behaviour at a relentless pace and also predict consumer patterns in order to take advantage of incoming opportunity.

In fact, consumer society today is almost a mirror image of businesses thirst for data in the here and now. We scan through emails as soon as they arrive, check Twitter and Facebook notifications instantaneously, root out a story to satisfy a hunger to know what’s going on, right here right now. Both organization and consumer are entrenched in the surrounding real-time data that none are actually bothering to dream big or think about tomorrow.

Being buried in today we seem to have forgotten all the little things we used to enjoy. For example, peppered in musical history are lyrics telling us to stop and smell the roses.

A dream you dream alone is only a dream. A dream you dream together is a reality – John Lennon

Don’t stop thinking about tomorrow – Fleetwood Mac

Think of tomorrow. Think of tomorrow – Chris Isaak

It is the future that they bring when tomorrow comes! - Les Miserables

Big Data and real-time/ right-time analytics present a challenge. Left unchecked they can turn a business to focus inward and forget about innovation in the same way that society is forgetting to plan and dream for a new day. Our minds are so busy being occupied with what’s happening right now we have no time to consider what future lies ahead of us, let alone try to shape one and so the same applies in business, we are so focused on predicting and reacting to events as fast as we can that we have no time or capacity to innovate.

Predicting the future is not the same as building a future. Real-time analytics give us insight and windows of opportunity but they do not control how we innovate and think about tomorrow and that difference needs to be understood and heeded before a business embarks on a Big Data grail quest.

Forget that difference and you might as well forget the next day.

Managing data at scale doesn’t have to be hard. Find out how the completely free, open source HPCC Systems platform makes it easier to update, easier to program, easier to integrate data, and easier to manage clusters. Download and get started today.


Published at DZone with permission of

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}