Spark - Log

Management

Directory

export SPARK_LOG_DIR=/var/log/spark2

Cluster

Standalone

Standalone or Local

Spark executor logs are located in the SPARK_HOME/work/app-

<AppName>'' directory (where <AppName>is the name of your application.

See Log

Driver logs are by default printed to console