DZone
Big Data Zone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
  • Refcardz
  • Trend Reports
  • Webinars
  • Zones
  • |
    • Agile
    • AI
    • Big Data
    • Cloud
    • Database
    • DevOps
    • Integration
    • IoT
    • Java
    • Microservices
    • Open Source
    • Performance
    • Security
    • Web Dev
DZone > Big Data Zone > Apache Spark Complex Event Processing, Training and SparkSQL Datawarehouse

Apache Spark Complex Event Processing, Training and SparkSQL Datawarehouse

A link sheet for those who want to learn more about using Apache Spark and data warehousing.

Tim Spann user avatar by
Tim Spann
CORE ·
Apr. 14, 16 · Big Data Zone · Opinion
Like (7)
Save
Tweet
13.63K Views

Join the DZone community and get the full member experience.

Join For Free

Apache Spark and Machine learning can solve a lot of problems and can discover patterns leading to rules replacement.  But for some simple cases and for legacy rules requires, you may still need to hand develop rules and implement in Java.  For those cases, Drools can be used with Spark.   Besides machine learning, CEP or complex event processing can be used as a replacement for standard IF-THEN-ELSE style hardcoded rules.

Siddhi Complex Event Processing Engine

Use Complex Event Processing (CEP) instead of rules:

Decision CEP Engine - complex event processing platform build on spark streaming

Architecture Guide

Spark plus Drools

Sprue

Break up your kafka messages

Rules / File Matching

Herzberg

Business Rules - JRules Data Mining

There's a ton of great presentations, webinars and short online courses for learning Spark.   Here are a few that I recommend.

More Free Spark Training

Apache Spark Essentials

Build and Monitor Spark Applications

Create Data Pipelines with Spark

MapR Free Spark Training

When implementing a SQL Datawarehouse on Hadoop with Spark, here are a few useful starters.

SQL Data Warehouse With Spark

SparkSQL Datawarehouse

Building a Datawarehouse

Spark Streaming for Robust Apps

Spark Summit Keynote

Memory-centric Distributed Storage System

Alluxio (Tachyon) - in memory

New Fast SQL Project

Alluxio is proving to be a great general purpose in memory file system.

Complex event processing Apache Spark Event Processing

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • What Is the Future of Humans With Artificial Intelligence (AI)?
  • The Web Performance APIs Reference
  • The 2-Minute Test for Kubernetes Pod Security
  • It's Official! Fat Arrows in JavaScript!

Comments

Big Data Partner Resources

X

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • MVB Program
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends:

DZone.com is powered by 

AnswerHub logo