Spark - Shell

Card Puncher Data Processing

Spark - Shell

About

The shell in different language.

A shell create normally automatically a context (connection, session) given the name sc.

List

Python

pyspark

Example of path: /usr/local/bin/spark-1.3.1-bin-hadoop2.6/bin/

Pyspark

Scala

spark-shell

R

SparkR

./bin/sparkR shell for R

Sparkr

Sparklyr

Spark inside RStudio for instance.

Jupyter

Jupyter notebook

SQL

Sql Shell

Spark Sql

Sparkling Water

See ML - SparklingWater (h20 inside Spark)







Share this page:
Follow us:
Task Runner