Spark On K8S 0.4.0

What's Changed

This release introduces new features for the API and webserver, including the ability to kill and delete Spark jobs and read driver pod logs directly from the webserver, and some improvements for the helm chart access service account permissions.

• feat(webserver): implement a UI to stream driver pod logs by @hussein-awala in #14
• chore: separate html templates and css styles by @hussein-awala in #15
• chore: separate sync and async app manager in two modules by @hussein-awala in #17
• feat: api routes to kill and delete spark app by @hussein-awala in #16
• fix: use websocket client in async kill_app to run pod exec by @hussein-awala in #18
• fix: remove duplicated app from app endpoints paths by @hussein-awala in #19
• feat: add kill and delete features to the webserver by @hussein-awala in #20
• fix: close the ws client properly by @hussein-awala in #21
• security: bump airflow version to 2.8.3 to avoid CVE-2024-28746 by @hussein-awala in #23
• feat(helm): support specific namespaces and swtiching between read and edit permissions by @hussein-awala in #24
• fix(webserver): fix the static folder path by @hussein-awala in #25
• fix(api): add missing websockets packages to api extra by @hussein-awala in #26
• chore(webserver): add a page to redirect to when there is a K8S error by @hussein-awala in #27

Full Changelog: 0.3.0...0.4.0