Apache Spark

This gallery shows examples of how to use Apache Spark with SWAN.
See also the online, self-paced training course on Apache Spark.

Spark for data processing, analytics, and machine learning

Tutorial on Spark DataFrame API

Tutorial on Spark SQL

Exercises on Spark SQL

JDBC Tutorial - Reading from Oracle using Spark

Machine Learning with Apache Spark - Classifier

Machine Learning with Apache Spark - Regression

Running Spark on CERN Hadoop clusters

Analytix cluster: Example of Spark on Hadoop

Analytix cluster: How to run the TPC-DS benchmark at scale with Spark and Hadoop

NXCALS: Spark for analyzing LHC logging data

NXCALS: Spark vector data and timestamps

Spark and LHC experiments' Open Data

An example using LHCb Open Data

Processing ROOT (NanoAOD) files with distributed ROOT RDataFrame

Processing Physics data using the Spark DataFrame API