About
The master defines the master service of a cluster manager where spark will connect.
The value of the master property defines the connection URL to this master.
Articles Related
Value
- local. Start the standalone spark locally. (The SPARK_HOME environment variable gives the installation directory)
- spark://hostnameMaster:port. Connect to the Standalone Spark Cluster manager: Example: spark://nicoLaptop:7077
- yarn. Connect to Yarn. See Yarn
- k8s://HOST:PORT. Connect to the Kubernetes cluster manager
Configuration
Env
The master can be passed through environment variable
setx MASTER="local[*]"