Spark Engine - Optimizer (Catalyst)

About

SQL Engine - Query Optimizer (Query Optimization)

Articles Related

Example

A map and a filter can be performed in one operation.

Documentation / Reference

• https://databricks.com/blog/2015/04/13/deep-dive-into-spark-sqls-catalyst-optimizer.html
• Code:
  • Analyzer.scala
  • Optimizer.scala
  • SparkStrategies.scala
  • CodeGenerator.scala