Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Why Your Data Isn't Big Data

DZone's Guide to

Why Your Data Isn't Big Data

· Big Data Zone
Free Resource

Need to build an application around your data? Learn more about dataflow programming for rapid development and greater creativity. 

According to DJ Walker-Morgan at MongoHQ, you don't have Big Data. You may have lots of data, but that doesn't mean Big Data. Walker-Morgan's recent post on the subject covers a number of different ideas regarding Big Data and what it all means. In particular, Walker-Morgan asks (and answers) why we keep so much data and why so much of it is of such little value.

Ultimately, though, Walker-Morgan's argument is that the lack of value in most Big Data is key to most peoples' misunderstanding of the concept. One of his central ideas is that of "hot data," which is data that is substantial in size and frequently requested; in other words, data that is actively in use. Big Data, on the other hand, Walker-Morgan calls "cold data." It may come in useful at some point, but it's generally only valuable in aggregate and when processed, and infrequently.

So, maybe your data isn't Big Data, so much as "hot data," and Walker-Morgan suggests that ignoring the distinction may lead to inefficiency and misguided efforts as Big Data practices are applied where they don't necessarily belong. Walker-Morgan's full post goes into more detail on the value of Big Data and the importance of the "hot data" distinction.

And don't worry, if you determine that you're not working with Big Data after all, Chris Stuccio has you covered.

Check out the Exaptive data application Studio. Technology agnostic. No glue code. Use what you know and rely on the community for what you don't. Try the community version.

Topics:

Opinions expressed by DZone contributors are their own.

THE DZONE NEWSLETTER

Dev Resources & Solutions Straight to Your Inbox

Thanks for subscribing!

Awesome! Check your inbox to verify your email so you can start receiving the latest in tech news and resources.

X

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}