Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[punet] Evaluate rescale efficiency #75

Open
stellaraccident opened this issue Jun 26, 2024 · 0 comments
Open

[punet] Evaluate rescale efficiency #75

stellaraccident opened this issue Jun 26, 2024 · 0 comments
Assignees

Comments

@stellaraccident
Copy link
Contributor

stellaraccident commented Jun 26, 2024

Currently for the punet model, we are doing scale math on all layers in f32 because some are sensitive to precision. We should do an experiment to see if there is an overall benefit to switching to lower precision or a different way of doing this. If so, we can spend some time on the simulator attempting to make it work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Todo
Development

No branches or pull requests

1 participant