Over a million developers have joined DZone.

Using Big Data to Keep the Power On

DZone's Guide to

Using Big Data to Keep the Power On

Big data is increasingly being used to ensure utility companies don't suffer from power outages. The outages can cost $8 billion/year, so this is an important venture.

· Big Data Zone ·
Free Resource

Hortonworks Sandbox for HDP and HDF is your chance to get started on learning, developing, testing and trying out new features. Each download comes preconfigured with interactive tutorials, sample data and developments from the Apache community.

I wrote a while back about how drone technology is increasingly being used to ensure utility companies don't suffer from power outages. At the forefront of this shift is drone company Sharper Shape. The company, which originated in Finland, recently secured a multi-million dollar funding round to aid its expansion into the U.S. market.

One of the main areas the company is working in is to ensure trees don't fall onto power lines. Whilst it sounds rather low-tech, it's a problem that causes utility companies to spend around six to eight billion USD each year to inspect both lines and neighboring trees to ensure mishaps don't occur.

Being able to predict the risk posed by falling trees is crucial, and a recent project from Texas A&M University utilizes big data to achieve that.

Smart Forecasting

The system aims to provide accurate predictions of where vulnerabilities are, and therefore where power outages might occur. This then allows preventative measures to be taken.

"The utility grids and related assets are mostly located outdoors and are exposed to all kinds of weather hazards. Dealing with aging infrastructure assets adds another layer of complexity that utility companies face," the team says. "Any kind of environmental data that has some relevance to the power system can be fed into this prediction framework."

The model is designed to be as flexible as possible, and therefore is capable of processing varying formats and data sources. This in itself is a significant challenge, as different sources of data present unique challenges. The team believes it can provide utilities with an invaluable service, however.

"The first and foremost goal of utility companies is to assure uninterrupted service," they say. "By improving reliability, we can predict outages. If we can prevent outages with historical and close-to-real-time data, we can save millions of dollars since the outages may be mitigated."

The system deployed a three-step process. First, they investigated the chances of a possible hazard, such as bad weather conditions. They then examined the risk this posed to utility assets before finally evaluating the impact such events might have and the cost involved in maintaining, replacing, and repairing the assets.

Key to the utility of such models is the accuracy of the data, and the team tapped into CenterPoint Energy's utility data alongside both historical and near real time weather data to predict vulnerabilities in the network of CenterPoint.

Whether it's models such as this or drones such as those from Sharper Shape, it seems clear that utility inspections will be getting smarter. If you would like to learn more about the Texas A&M's research, check out the video below.

Hortonworks Community Connection (HCC) is an online collaboration destination for developers, DevOps, customers and partners to get answers to questions, collaborate on technical articles and share code examples from GitHub.  Join the discussion.

big data ,drones ,inspections ,utilities ,weather

Published at DZone with permission of

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}