Spark On K8S 0.11.0

What's Changed

Significant Changes

• chore: remove support for Python 3.8 by @hussein-awala in #96

Bug Fixes:

• fix(chart): add missing config to spark-history deployment by @hussein-awala in #104
• fix(doc): fix failed mkdocs and remove warnings by @hussein-awala in #111
• fix(webserver): fix broken apps endpoint by @hussein-awala in #117
• fix(python-client): truncate driver pod name and fix app name/id truncation by @hussein-awala in #119

New Features:

• feat(airflow): add on_finish_action to decide what to do when the job finishes by @hussein-awala in #100
• feat(python-client): add more config for dynamic allocation by @hussein-awala in #102
• feat(cli): add more config for dynamic allocation by @hussein-awala in #103
• feat(airflow): create SparkSqlOnK8SOperator to execute Spark SQL commands by @hussein-awala in #109
• feat(python-client): Support for init containers in driver pod by @hussein-awala in #121
• feat(python-client): Support for host aliases in driver pod by @hussein-awala in #122

Misc

• chore(airflow): create an enum for app_waiter by @hussein-awala in #101
• chore(spark-history): update spark-history image to jdk 17 and spark 3.5.3 by @hussein-awala in #105
• chore: update spark version in java example by @hussein-awala in #107
• chore: user StrEnum instead of str, Enum by @hussein-awala in #108
• chore(doc): add some examples for SparkSqlOnK8SOperator operator by @hussein-awala in #112
• chore: add sqlfluff to lint spark sql queries by @hussein-awala in #113
• chore(doc): add some examples for driver configuration by @hussein-awala in #125

Full Changelog: 0.10.1...0.11.0