Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A feature enhancement is proposed: Stand up a process for generating model containers #91

Open
KatherinePowell-NOAA opened this issue May 23, 2024 · 4 comments
Assignees

Comments

@KatherinePowell-NOAA
Copy link

Model software containerization.

Current state: "running a model" or "doing a run" is actually a build step and a compile step. There should be a possibility of a "buildtime" machine and a "runtime" machine.

This is what happens with cloudflow, in that the head node appears to be the "build" machine (and the scheduler) and the worker nodes of the cluster execute things as a runtime action. This can (and should) be broken out by the time Mykel is finished with the containerization.

@KatherinePowell-NOAA
Copy link
Author

Is it at all possible that we could strip down the head node to be a runtime-only node and purpose-build a machine as a container to perform compilation as part of a CI process rather than as part of "running the model"? Does more compilation happen after the run?

If we did both of those things, then the head node could be an unconfigured basic image that we could do whatever needed to be done with it. That also means that we would need to directly replicate the head node and any relevant worker nodes as containers (i.e. what I'm trying to do these days) such that a non-CAC user could make use of for a docker-compose. It would also mean that the compilation process might be workable inside something like Github.

@mykelalvis
Copy link
Contributor

I cannot be assigned here.

@KatherinePowell-NOAA
Copy link
Author

Mykel added documentation for model generation in the sandbox (internal draft to be shared later), and specific model configurations and dependencies for CORA/ADCIRC after 7/30/2024 meeting with John Ratcliff.

@KatherinePowell-NOAA KatherinePowell-NOAA changed the title Stand up a process for generating model containers A feature enhancement was proposed: Stand up a process for generating model containers Aug 16, 2024
@KatherinePowell-NOAA KatherinePowell-NOAA changed the title A feature enhancement was proposed: Stand up a process for generating model containers A feature enhancement is proposed: Stand up a process for generating model containers Aug 16, 2024
@breannalcv
Copy link

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants