DZone
Big Data Zone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
  • Refcardz
  • Trend Reports
  • Webinars
  • Zones
  • |
    • Agile
    • AI
    • Big Data
    • Cloud
    • Database
    • DevOps
    • Integration
    • IoT
    • Java
    • Microservices
    • Open Source
    • Performance
    • Security
    • Web Dev
DZone > Big Data Zone > Spark and Scala Resources

Spark and Scala Resources

A resource list for Spark and Scala newbies looking to get started with both.

Tim Spann user avatar by
Tim Spann
CORE ·
Apr. 19, 16 · Big Data Zone · Opinion
Like (10)
Save
Tweet
8.58K Views

Join the DZone community and get the full member experience.

Join For Free

Github Resources 

Github Resources - Scala Workshop

Setup Resources

  • Download Scala 2.10.x

  • Download Apache Spark 1.6 (Prebuild with Hadoop)

  • Scala Install

Setup

Make sure you have the Java 7 or Java 8 SDK installed for your platform (Mac, Linux or Windows).   Then you’ll need to download Scala 2.10.x, SBT and then Spark.   I also recommend downloading Maven. 

Solving Local Spark Issues

export SPARK_MASTER_IP=127.0.0.1
export SPARK_LOCAL_IP=127.0.0.1
export SCALA_HOME=~/Downloads/scala-2.10.6
export PATH=$PATH:$SCALA_HOME/bin

For Windows, use SET instead of EXPORT and ; and not :.

Books

  • Learning Spark

  • Scala by Example by Odersky – most material is from or similar to material covered in both of his classes on Coursera.

  • Scala Overview by Odersky et al.

  • Programming in Scala, First Edition by Odersky.

  • Structure and Interpretation of Computer Programs A classic computer science text that teaches some advanced programming concepts using Lisp and the basis of Martin Odersky‘s coursera class. Formerly the MIT standard text on programming. View on Amazon

  • Scala for the Impatient

  • Programming Scala

  • A big list of Scala books linked at Scala-Lang

  • Learning Spark

  • Advanced Analytics with Spark

  • Spark Cookbook

Tutorials

  • Scala for Java Programmers

  • Scala Tutorial

  • Effective Scala (Twitter)

  • Scala Tour

E-Books

  • Books at Lightbend (Typesafe)

  • AtomicScala (sample)

Scala Koans/Exercises

  • Scala Exercises

  • Scala Koans

Resources

  • Scala Roundup for Java Engineers

  • Scala Info at StackOverflow

  • Scala Cheetsheats

  • Scala Notes

  • Cake Solutions Blog

  • Scala School (Twitter)

  • Functional Programming in Scala

  • How to Learn Scala

  • Scala Lang Overviews

  • Learning Scala in Small Bites

Online Free Courses – Scala

  • Functional Programming with Scala

  • Reactive Programming with Scala

Online Free Courses – Spark

  • Big Data Analysis with Spark

  • Distributed Machine Learning with Spark

  • Introduction to Spark

  • Spark Fundamentals

  • Data Science / Engineering Spark

  • CS100

  • CS190

Scala (programming language)

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • The Evolution of Configuration Management: IaC vs. GitOps
  • A Guide to Events in Vue
  • Usage of Java Streams and Lambdas in Selenium WebDriver
  • What Is ERP Testing? - A Brief Guide

Comments

Big Data Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • MVB Program
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends:

DZone.com is powered by 

AnswerHub logo