DZone
Big Data Zone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
  • Refcardz
  • Trend Reports
  • Webinars
  • Zones
  • |
    • Agile
    • AI
    • Big Data
    • Cloud
    • Database
    • DevOps
    • Integration
    • IoT
    • Java
    • Microservices
    • Open Source
    • Performance
    • Security
    • Web Dev
DZone > Big Data Zone > Spark Summit East 2016 Report Day 1

Spark Summit East 2016 Report Day 1

A report of the first day of Spark Summit East 2016 from Zone Leader Tim Spann.

Tim Spann user avatar by
Tim Spann
CORE ·
Mar. 16, 16 · Big Data Zone · Opinion
Like (4)
Save
Tweet
3.78K Views

Join the DZone community and get the full member experience.

Join For Free

Top Links:

  • Most Interesting Talks

  • How to Predict Telco Churn with Apache Spark MLlib

Matei Zaharia told us about all the amazing things coming in the next release in May. This includes API consolidation, new structured streaming and performance enhancements. A preview of this can be run inside the Databricks Cloud.

Shaun Connolly from Hortonworks did an excellent keynote on Spark and Hadoop in practice and really interesting talk about all that you can do with the wealth of open source tools in the space.

Anjul Bhambhri from IBM did a great keynote about IBM's innovation, investment, and enhancement to Spark through SystemML and other features and libraries they are adding. IBM's billion dollar investment and weaving Spark into products like Watson really helps extend Spark into the Enterprise.

Netflix did a great talk (as their team always does) on an interesting application they are working for that makes Netflix cool. "Distributed Time Travel for Feature Generation" was a really cool example of adding historic data to Spark jobs. They will be open sourcing another tool around this soon. Netflix is a great contributor to open source and their embrace of releasing amazing tools and products is an example to all enterprises.

Prasad Chalasani from MediaMath did an excellent talk, "Monte Carlo Simulations in Ad-Lift Measurement Using Spark". They are doing some cool data science with Spark for determining if advertisements are working.

Great news coming out of Databricks is now they have a free Community Edition of the Databricks Cloud being made available soon.  Spark Summit East 2016 participants will be the beta testers and get early access. I will review this once I get my account. From the demos, it's the same great features of the Databricks Cloud along with social feature for up to 3 users to share notebooks, extensive documentation with built-in runnable notebooks, and the entire content from th Inde Spark MOOC also with built-in runnable notebooks. Again Databricks embracing the free training of developers in Spark and helping build the community. This is a must do.

Another cool item from Databricks is their Dashboard view of Databricks Cloud Notebooks. You can now share HTML views of your notebook over the Internet. This is for the enterprise version and the community edition. This is awesome! I will embed them in some
upcoming posts once I get access. This allows for sharing of live data and a is great asset for learning, bloggers and the enterprise. Thanks Databricks! Indeed, "Spark, I am Your Father", rings true. Databricks is a great example of a company stewarding an amazing open source project.

Open source Data science

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • Top 20 Git Commands With Examples
  • Servlets Listeners Introduction and Examples
  • 5 Steps to Effective KYC Compliance
  • Memory Debugging and Watch Annotations

Comments

Big Data Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • MVB Program
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends:

DZone.com is powered by 

AnswerHub logo