Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Apache Spark Complex Event Processing, Training and SparkSQL Datawarehouse

DZone's Guide to

Apache Spark Complex Event Processing, Training and SparkSQL Datawarehouse

A link sheet for those who want to learn more about using Apache Spark and data warehousing.

· Big Data Zone
Free Resource

Learn best practices according to DataOps. Download the free O'Reilly eBook on building a modern Big Data platform.

Apache Spark and Machine learning can solve a lot of problems and can discover patterns leading to rules replacement.  But for some simple cases and for legacy rules requires, you may still need to hand develop rules and implement in Java.  For those cases, Drools can be used with Spark.   Besides machine learning, CEP or complex event processing can be used as a replacement for standard IF-THEN-ELSE style hardcoded rules.

Siddhi Complex Event Processing Engine

Use Complex Event Processing (CEP) instead of rules:

Decision CEP Engine - complex event processing platform build on spark streaming

Architecture Guide

Spark plus Drools

Sprue

Break up your kafka messages

Rules / File Matching

Herzberg

Business Rules - JRules Data Mining

There's a ton of great presentations, webinars and short online courses for learning Spark.   Here are a few that I recommend.

More Free Spark Training

Apache Spark Essentials

Build and Monitor Spark Applications

Create Data Pipelines with Spark

MapR Free Spark Training

When implementing a SQL Datawarehouse on Hadoop with Spark, here are a few useful starters.

SQL Data Warehouse With Spark

SparkSQL Datawarehouse

Building a Datawarehouse

Spark Streaming for Robust Apps

Spark Summit Keynote

Memory-centric Distributed Storage System

Alluxio (Tachyon) - in memory

New Fast SQL Project

Alluxio is proving to be a great general purpose in memory file system.

Find the perfect platform for a scalable self-service model to manage Big Data workloads in the Cloud. Download the free O'Reilly eBook to learn more.

Topics:
big data ,spark ,apache spark ,spark sql

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}