Skip to content
This repository has been archived by the owner on Feb 12, 2024. It is now read-only.

Standalone Spark - better Kubernetes integration #25

Open
banzo opened this issue Feb 6, 2020 · 1 comment
Open

Standalone Spark - better Kubernetes integration #25

banzo opened this issue Feb 6, 2020 · 1 comment
Labels
enhancement New feature or request

Comments

@banzo
Copy link
Contributor

banzo commented Feb 6, 2020

New versions of Spark have better Kubernetes integration: https://kubernetes.io/blog/2018/03/apache-spark-23-with-native-kubernetes/

This sample chart provides some information on the deeper integration, but also highlights possible limitations, this need to be studied a bit deeper.

Thanks to @terence-bigtt for the heads up.
@banzo banzo added the enhancement New feature or request label Feb 6, 2020
@banzo
Copy link
Contributor Author

banzo commented Apr 27, 2021

We might want to implement this as an operator: https://github.com/GoogleCloudPlatform/spark-on-k8s-operator

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@banzo