quantization

[snehashis1997]

can we infer the Pytorch int8 model? what is the benchmark report pytorch int8 vs trt int8?

[levipereira]

I did not develop PyTorch QAT; I simply used the PyTorch-Quantization toolkit as an intermediate step to simulate QAT. The ultimate goal is to use QAT in TensorRT, leveraging NVIDIA's high-performance integer kernels which utilize integer Tensor Cores.