Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

qat量化能够导出onnx,能够在tensorrt上进行部署吗? #23

Open
scuizhibin opened this issue Aug 22, 2023 · 3 comments
Open

Comments

@scuizhibin
Copy link

No description provided.

@gdh1995
Copy link
Collaborator

gdh1995 commented Aug 27, 2023

原理和torch的qat是一致的,都是额外加onnx node来存储量化信息,所以理论上肯定能在 trt 跑,只是仓库里目前的代码不一定跑得通,可能需要你看着改改

@scuizhibin
Copy link
Author

scuizhibin commented Aug 27, 2023 via email

@gdh1995
Copy link
Collaborator

gdh1995 commented Sep 9, 2023

啊我也不咋了解torch的qat,只是按官网例子跑过几天,有两年没接触了没法解答

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants