Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallelize fetching version tags from GitHub #314

Open
dbeatty10 opened this issue Apr 5, 2024 · 0 comments
Open

Parallelize fetching version tags from GitHub #314

dbeatty10 opened this issue Apr 5, 2024 · 0 comments

Comments

@dbeatty10
Copy link
Contributor

Currently, the hubcap.py script takes 15+ minutes to execute end-to-end.

The slowest part of executing the hubcap.py script is cloning each of the GitHub repos so that we can determine if there are any new tags or not.

This becomes a bottleneck that is constrained by the network, so we spend a lot of time waiting as we serially download each repo.

Is there any way we could parallelize this step so the script doesn't take so long to execute?

Most of the steps that can cause failures happen after this bottleneck is cleared, so during troubleshooting, we often have to wait 15+ minutes to determine if a fix worked or didn't.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant