Over a million developers have joined DZone.

Google Big Query Now Supports Pearson Correlation

DZone's Guide to

Google Big Query Now Supports Pearson Correlation

· Big Data Zone ·
Free Resource

Hortonworks Sandbox for HDP and HDF is your chance to get started on learning, developing, testing and trying out new features. Each download comes preconfigured with interactive tutorials, sample data and developments from the Apache community.

During this year's I/O conference, Google announced the ability to perform correlation on its BigQuery platform.   As of late last week, that functionality is now available to all BigQuery users! 

By using the CORR() function in BigQuery, you can now output correlation values between two variables in your dataset within the same SELECT statement queries you are accustomed to with BigQuery.  A blog post on Google's Cloud Platform Blog demonstrates a great example of CORR() in action with some sample data taken during the I/O conference using various sensor readings for temperature, humidity, noise and other environmental data.  Your work ends with defining the two variables you are interested in within your query and then BigQuery will do the heavy lifting by performing the Pearson Correlation function across your dataset for you and providing it in the output.

Hortonworks Community Connection (HCC) is an online collaboration destination for developers, DevOps, customers and partners to get answers to questions, collaborate on technical articles and share code examples from GitHub.  Join the discussion.


Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}