Over a million developers have joined DZone.

Why Your Data Isn't Big Data

· Big Data Zone

Learn how you can maximize big data in the cloud with Apache Hadoop. Download this eBook now. Brought to you in partnership with Hortonworks.

According to DJ Walker-Morgan at MongoHQ, you don't have Big Data. You may have lots of data, but that doesn't mean Big Data. Walker-Morgan's recent post on the subject covers a number of different ideas regarding Big Data and what it all means. In particular, Walker-Morgan asks (and answers) why we keep so much data and why so much of it is of such little value.

Ultimately, though, Walker-Morgan's argument is that the lack of value in most Big Data is key to most peoples' misunderstanding of the concept. One of his central ideas is that of "hot data," which is data that is substantial in size and frequently requested; in other words, data that is actively in use. Big Data, on the other hand, Walker-Morgan calls "cold data." It may come in useful at some point, but it's generally only valuable in aggregate and when processed, and infrequently.

So, maybe your data isn't Big Data, so much as "hot data," and Walker-Morgan suggests that ignoring the distinction may lead to inefficiency and misguided efforts as Big Data practices are applied where they don't necessarily belong. Walker-Morgan's full post goes into more detail on the value of Big Data and the importance of the "hot data" distinction.

And don't worry, if you determine that you're not working with Big Data after all, Chris Stuccio has you covered.

Hortonworks DataFlow is an integrated platform that makes data ingestion fast, easy, and secure. Download the white paper now.  Brought to you in partnership with Hortonworks

Topics:

Opinions expressed by DZone contributors are their own.

The best of DZone straight to your inbox.

SEE AN EXAMPLE
Please provide a valid email address.

Thanks for subscribing!

Awesome! Check your inbox to verify your email so you can start receiving the latest in tech news and resources.
Subscribe

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}