Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[New Feature]: Reduce OPERA PCM deployment time by breaking out and reducing dependencies in terraform files #1067

Open
philipjyoon opened this issue Jan 27, 2025 · 0 comments
Assignees
Labels
enhancement New feature or request needs triage Issue that requires triage

Comments

@philipjyoon
Copy link
Contributor

Checked for duplicates

Yes - I've already checked

Alternatives considered

Yes - and alternatives don't suffice

Related problems

No response

Describe the feature request

I think there's a way to cut down deployment time by like 20-30 mins. Mozart instance creation depends metrics creation but it doesn't really need it until half way through when it's running sds commands. I don't know why it depends only on metrics and not factotum or grq because it runs the same sds commands for those boxes too. In the same vein, install_pcm_and_pge null_resource depends on mozart but all it needs is for the EC2 to be up. But mozart instantiation has a bunch of remote-execs that are part of the EC2 creation so install_pcm_and_pge doesn't kick in until ALL mozart services and files are installed which is not necessary. So I think these are the false, unnecessary dependencies we have in our terraform.

So if we break out all the remote-execs of Mozart and Metrics into one null_resource instead then the other subsequent (mozart creation and install_pcm_and_pge) can run much earlier and run in parallel - which is how terraform is supposed to work.

@philipjyoon philipjyoon added enhancement New feature or request needs triage Issue that requires triage labels Jan 27, 2025
@philipjyoon philipjyoon self-assigned this Jan 27, 2025
philipjyoon added a commit that referenced this issue Jan 28, 2025
…_pges run in parallel. This saves 20 mins of deploymnt time on dev cluster: 1 hour and 15 mins to 54 mins
hhlee445 added a commit that referenced this issue Jan 30, 2025
…endencies

#1067: Refactored mozart.tf so that deploy_pges.py and deploy_pcm_and…
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request needs triage Issue that requires triage
Projects
None yet
Development

No branches or pull requests

1 participant