Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Shared In-Memory RDDs [Video]

DZone's Guide to

Shared In-Memory RDDs [Video]

Using Spark SharedRDDs using Apache Ignite to improve Spark job performance with full walk through of configuration and usage.

· Big Data Zone ·
Free Resource

How to Simplify Apache Kafka. Get eBook.

Speaker: Nikita Ivanov, Founder and CTO GridGain Systems

In this talk I’ll present the SharedRDD – a high-performance in-memory caching layer for Spark jobs. We’ll work through 1) design and architecture of this component, 2) configuration, and 3) actual Java and Scala usage examples.


Topics:
in-memory data ,spark ,java ,ignite ,scala

Published at DZone with permission of

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}