Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Avoiding thundering herd issue with aggregation window start/stop #79

Open
anvinjain opened this issue Mar 22, 2017 · 0 comments
Open

Comments

@anvinjain
Copy link

When backend dies and comes back up, it receives all associated process groups and starts aggregation windows for all of them. They all compete for slots, some of them get it, rest wait till next aggregation window switch. Since all of them start at the same time, they will stop at the same time as well(provided aggregation window duration is same for all, which is true for v1 release at least). So slot competition will happen again and can lead to starvation for some process groups. Also contention on buffer pool when serializing profiles.

Possible solution is to introduce chaos(jitter) when starting profiles so that they space out well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant