DZone
Big Data Zone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
  • Refcardz
  • Trend Reports
  • Webinars
  • Zones
  • |
    • Agile
    • AI
    • Big Data
    • Cloud
    • Database
    • DevOps
    • Integration
    • IoT
    • Java
    • Microservices
    • Open Source
    • Performance
    • Security
    • Web Dev
DZone > Big Data Zone > Do You Trust Google Big Query with Your Big Data?

Do You Trust Google Big Query with Your Big Data?

Tharindu Mathew user avatar by
Tharindu Mathew
·
Jun. 25, 12 · Big Data Zone · Interview
Like (0)
Save
Tweet
3.51K Views

Join the DZone community and get the full member experience.

Join For Free

google has come up with a fantastic service to analyze large amounts of data. it’s called bigquery and it allows you to run analysis on big data on the cloud. as expected, the tool has a superb, intuitive web ui. the data analysis language uses sql like queries. ( hive , anyone ;) ). have a look at the big query tutorial , it looks pretty neat. so, now all you need to do to run queries is to upload your data to google using the form shown below.

it allows you to upload a file or point to it using google’s cloud storage.

now, the interesting question here is that to analyze using bigquery how much of that data are you willing to give google? and how long will that take? the answer won’t be “let me quickly upload a 500 gb file and run some queries”. that amount of data would definitely take some time to upload. so, effectively, this saas becomes pretty useless as more and more data volumes need to be uploaded for analysis.

everyone trusts google ( :) ), so this concern might be easily ignored. but a potential other problem i see is the “privacy policies” that are violated. usually, when you want to analyze data, it can contain sensitive data such as user behavior patterns and so forth. how comfortable will your customers be if you hand that data over to google? even anonymizing this data might not save you from a potential legal breach.

i still believe setting up your own data analysis and monitoring platform is the best way to go. thoughts? i’d love to hear them.

Big data Google (verb) Database Trust (business)

Published at DZone with permission of Tharindu Mathew, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • Java: Why Core-to-Core Latency Matters
  • Refactoring Java Application: Object-Oriented And Functional Approaches
  • Open Source Security Risks
  • Top Soft Skills to Identify a Great Software Engineer

Comments

Big Data Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • MVB Program
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends:

DZone.com is powered by 

AnswerHub logo