Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Spark and Scala Resources

DZone's Guide to

Spark and Scala Resources

A resource list for Spark and Scala newbies looking to get started with both.

· Big Data Zone
Free Resource

Learn best practices according to DataOps. Download the free O'Reilly eBook on building a modern Big Data platform.

Github Resources 

Github Resources - Scala Workshop

Setup Resources

Setup

Make sure you have the Java 7 or Java 8 SDK installed for your platform (Mac, Linux or Windows).   Then you’ll need to download Scala 2.10.x, SBT and then Spark.   I also recommend downloading Maven. 

Solving Local Spark Issues

export SPARK_MASTER_IP=127.0.0.1
export SPARK_LOCAL_IP=127.0.0.1
export SCALA_HOME=~/Downloads/scala-2.10.6
export PATH=$PATH:$SCALA_HOME/bin

For Windows, use SET instead of EXPORT and and not :.

Books

Tutorials

E-Books

Scala Koans/Exercises

Resources

Online Free Courses – Scala

Online Free Courses – Spark

Find the perfect platform for a scalable self-service model to manage Big Data workloads in the Cloud. Download the free O'Reilly eBook to learn more.

Topics:
apache spark ,spark ,spark sql ,big data

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}