-
Notifications
You must be signed in to change notification settings - Fork 213
Open
Labels
Description
when i do the :
# Do per-tensor fp8 calibration torchrun --nproc-per-node 8 --master_port=12346 ptq2.py --model_path /work/models/v32-mid --config /work/models/TensorRT-Model-Optimizer/modelopt/DeepSeek-V3.2-Exp/inference/config_671B_v3.2.json --quant_cfg FP8_DEFAULT_CFG --output_path ds_v32_fp8_per_tensor_calibration
in hopper H20 96G
