Over a million developers have joined DZone.

Google Big Query Now Supports Pearson Correlation

DZone's Guide to

Google Big Query Now Supports Pearson Correlation

· Big Data Zone ·
Free Resource

The Architect’s Guide to Big Data Application Performance. Get the Guide.

During this year's I/O conference, Google announced the ability to perform correlation on its BigQuery platform.   As of late last week, that functionality is now available to all BigQuery users! 

By using the CORR() function in BigQuery, you can now output correlation values between two variables in your dataset within the same SELECT statement queries you are accustomed to with BigQuery.  A blog post on Google's Cloud Platform Blog demonstrates a great example of CORR() in action with some sample data taken during the I/O conference using various sensor readings for temperature, humidity, noise and other environmental data.  Your work ends with defining the two variables you are interested in within your query and then BigQuery will do the heavy lifting by performing the Pearson Correlation function across your dataset for you and providing it in the output.

Learn how taking a DataOps approach will help you speed up processes and increase data quality by providing streamlined analytics pipelines via automation and testing. Learn More.


Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}