Spark and Scala Resources
A resource list for Spark and Scala newbies looking to get started with both.
Join the DZone community and get the full member experience.
Join For FreeGithub Resources
Github Resources - Scala Workshop
Setup Resources
Setup
Make sure you have the Java 7 or Java 8 SDK installed for your platform (Mac, Linux or Windows). Then you’ll need to download Scala 2.10.x, SBT and then Spark. I also recommend downloading Maven.
Solving Local Spark Issues
export SPARK_MASTER_IP=127.0.0.1
export SPARK_LOCAL_IP=127.0.0.1
export SCALA_HOME=~/Downloads/scala-2.10.6
export PATH=$PATH:$SCALA_HOME/binFor Windows, use SET instead of EXPORT and ; and not :.
Books
Scala by Example by Odersky – most material is from or similar to material covered in both of his classes on Coursera.
Scala Overview by Odersky et al.
Programming in Scala, First Edition by Odersky.
Structure and Interpretation of Computer Programs A classic computer science text that teaches some advanced programming concepts using Lisp and the basis of Martin Odersky‘s coursera class. Formerly the MIT standard text on programming. View on Amazon
Tutorials
E-Books
Scala Koans/Exercises
Resources
Online Free Courses – Scala
Online Free Courses – Spark
Topics:
apache spark,
spark,
spark sql,
big data
Opinions expressed by DZone contributors are their own.
Comments