Over a million developers have joined DZone.

On Organizations’ Real Requirements Around Big Data

DZone's Guide to

On Organizations’ Real Requirements Around Big Data

· Big Data Zone ·
Free Resource

The open source HPCC Systems platform is a proven, easy to use solution for managing data at scale. Visit our Easy Guide to learn more about this completely free platform, test drive some code in the online Playground, and get started today.

Every time another vendor takes the “big data” moniker and applies it to some legacy system a cat somewhere on the internet dies. Like “cloud” a couple of years ago, big data has become the term de jour – and vendors seem to think that simply using it will give them some magic power to up their revenues, their margins and their count of unicorns and rainbows. Yeah, in case you didn’t realize, the overuse of the term makes me cringe.

But that doesn’t mean that big data isn’t a valid concept per se. We live in a world where the amount of information is increasing rapidly. Where the number of individual devices connected to the net is exponentially rising. where organizations want to make some sense of the world around them – all reasons where big data can help.

So it was interesting to see the results of a survey that GigaSpaces commissioned into the use of big data in industry, and the pressing drivers for this use. The survey that GigaSpaces did was of 243 IT executives and developers spanning a bunch of different industries. Obviously 243 is a small number, and no doubt the survey pool was skewed somewhat by the focus, network and perspective of GigaSpaces, but as a general snapshot, it’s informative. So, some interesting statistics:

  • 80% say big data processing is “mission critical”
  • 70% have a need to process big data in real time
  • 80% are planning to move their big data processing to the cloud

So – what does this all mean?


Like I said, big data provides a real opportunity for organizations to make smarter decisions in a more rapid manner. But to get over the line in terms of selling projects within an enterprise – big data initiatives really can’t require a significant investment in kit. They also can’t create a drain on existing hardware. A move to cloud processing is therefore a natural step. At the same time, there is little point in assessing big data after the fact – the goal of big data is to be able to react to trends near instantaneously.

It’s interesting that the past couple of weeks have seen some interesting announcements from both AWS and HP about big data analysis initiatives that deliver on both these trends – likely a sign of things to come. Big data is going to be an important industry shift over the next few years – but users need to have products that allow it to harness big data insights rapidly and outside of their existing technology kit – this survey reiterates that fact.

Managing data at scale doesn’t have to be hard. Find out how the completely free, open source HPCC Systems platform makes it easier to update, easier to program, easier to integrate data, and easier to manage clusters. Download and get started today.


Published at DZone with permission of

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}