Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make partition processor placements configurable #2243

Open
Tracked by #1815
tillrohrmann opened this issue Nov 7, 2024 · 0 comments
Open
Tracked by #1815

Make partition processor placements configurable #2243

tillrohrmann opened this issue Nov 7, 2024 · 0 comments

Comments

@tillrohrmann
Copy link
Contributor

tillrohrmann commented Nov 7, 2024

To control how partition processors are placed, we need to make the placement configurable. The configuration could include the overall partition processor placement strategy (ReplicationStrategy::OnAllNodes, ReplicationStrategy::Factor) or a specific set of worker nodes. Additionally, it should allow to configure a specific worker node to be the leader. Based on this configuration, the Scheduler should accept all equivalent placements as acceptable.

Additionally, we need an API to modify this configuration (e.g. by storing it in the metadata store so that all nodes read it eventually).

@tillrohrmann tillrohrmann changed the title Make partition placements configurable Make partition processor placements configurable Nov 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant