Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Why Your Data Isn't Big Data

DZone's Guide to

Why Your Data Isn't Big Data

· Big Data Zone
Free Resource

NoSQL & Big Data Integration through standard drivers (ODBC, JDBC, ADO.NET). Free Download

According to DJ Walker-Morgan at MongoHQ, you don't have Big Data. You may have lots of data, but that doesn't mean Big Data. Walker-Morgan's recent post on the subject covers a number of different ideas regarding Big Data and what it all means. In particular, Walker-Morgan asks (and answers) why we keep so much data and why so much of it is of such little value.

Ultimately, though, Walker-Morgan's argument is that the lack of value in most Big Data is key to most peoples' misunderstanding of the concept. One of his central ideas is that of "hot data," which is data that is substantial in size and frequently requested; in other words, data that is actively in use. Big Data, on the other hand, Walker-Morgan calls "cold data." It may come in useful at some point, but it's generally only valuable in aggregate and when processed, and infrequently.

So, maybe your data isn't Big Data, so much as "hot data," and Walker-Morgan suggests that ignoring the distinction may lead to inefficiency and misguided efforts as Big Data practices are applied where they don't necessarily belong. Walker-Morgan's full post goes into more detail on the value of Big Data and the importance of the "hot data" distinction.

And don't worry, if you determine that you're not working with Big Data after all, Chris Stuccio has you covered.

Easily connect any BI, ETL, or Reporting tool to any NoSQL or Big Data database with CData Drivers (ODBC, JDBC, ADO.NET). Download Now

Topics:

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}