Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Why Your Data Isn't Big Data

DZone's Guide to

Why Your Data Isn't Big Data

· Big Data Zone
Free Resource

Effortlessly power IoT, predictive analytics, and machine learning applications with an elastic, resilient data infrastructure. Learn how with Mesosphere DC/OS.

According to DJ Walker-Morgan at MongoHQ, you don't have Big Data. You may have lots of data, but that doesn't mean Big Data. Walker-Morgan's recent post on the subject covers a number of different ideas regarding Big Data and what it all means. In particular, Walker-Morgan asks (and answers) why we keep so much data and why so much of it is of such little value.

Ultimately, though, Walker-Morgan's argument is that the lack of value in most Big Data is key to most peoples' misunderstanding of the concept. One of his central ideas is that of "hot data," which is data that is substantial in size and frequently requested; in other words, data that is actively in use. Big Data, on the other hand, Walker-Morgan calls "cold data." It may come in useful at some point, but it's generally only valuable in aggregate and when processed, and infrequently.

So, maybe your data isn't Big Data, so much as "hot data," and Walker-Morgan suggests that ignoring the distinction may lead to inefficiency and misguided efforts as Big Data practices are applied where they don't necessarily belong. Walker-Morgan's full post goes into more detail on the value of Big Data and the importance of the "hot data" distinction.

And don't worry, if you determine that you're not working with Big Data after all, Chris Stuccio has you covered.

Learn to design and build better data-rich applications with this free eBook from O’Reilly. Brought to you by Mesosphere DC/OS.

Topics:

Opinions expressed by DZone contributors are their own.

THE DZONE NEWSLETTER

Dev Resources & Solutions Straight to Your Inbox

Thanks for subscribing!

Awesome! Check your inbox to verify your email so you can start receiving the latest in tech news and resources.

X

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}