Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/Enhancement Request - Support for cost and user tracking #6523

Open
Waqiah opened this issue Oct 31, 2024 · 3 comments
Open

Feature/Enhancement Request - Support for cost and user tracking #6523

Waqiah opened this issue Oct 31, 2024 · 3 comments

Comments

@Waqiah
Copy link

Waqiah commented Oct 31, 2024

Hello Team,

I understand that ParallelCluster does not support user or cost tracking natively at this moment, therefore I would like to put in this feature request of allowing:

  • The tagging a slurm compute node dynamically when a user procures a compute node from slurm. Such as to add/update a subset of tags based on values passed to slurm node (eg. login name).
  • To allow the setting of other compute node tagging based on other rules apart from CustomActions.

Currently the below blog has been suggested as a potential workaround:
https://swsmith.cc/posts/cost-explorer-pcluster.html

However I would like this to be a native feature.

@joehellmersNOAA
Copy link

Another way to do this would be to use an RDS database for Slurm accounting. It would cost a bit for the database, but it might be worth it if you want to track usage and costs.

https://docs.aws.amazon.com/parallelcluster/latest/ug/slurm-accounting-v3.html

@hanwen-pcluste
Copy link
Contributor

Thank you for the feature request. Our team will discuss this.

@maestro7879
Copy link

I had users add the below to their sbatch submission file, the goal being to track costs in AWS Cost Explorer. -
MyInstID=$(srun --nodes=15 ec2-metadata --instance-id | cut -d " " -f 2)
srun --nodes=15 aws ec2 create-tags --resources $MyInstID --tags Key=Name,Value="Compute-Joe Vanilla" --region us-east-1

Not ideal but it works.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants