vllm单机多卡infer报 Some keys are not used by the HfArgumentParser: ['vllm_config']

[QiQingY]

我使用最新推荐的vllm_infer.py脚本进行Qwen2.5_72B_Instruct infer的时候，报Some keys are not used by the HfArgumentParser: ['vllm_config']的错误，我的运行脚本如下：

python vllm_infer.py \
 --model_name_or_path /llm_base_model/Qwen/Qwen2___5-72B-Instruct \
 --adapter_name_or_path saves/QueryToPath/20241213_103756/Qwen2___5-72B-Instruct_adapter/ \
 --dataset QueryToPath_iid_test_sft_sample

完整报错如下：

/opt/conda/lib/python3.8/site-packages/torchvision/io/image.py:13: UserWarning: Failed to load image Python extension: '/opt/conda/lib/python3.8/site-packages/torchvision/image.so: undefined symbol: _ZN3c1017RegisterOperatorsD1Ev'If you don't plan on using image functionality from `torchvision.io`, you can ignore this warning. Otherwise, there might be something wrong with your environment. Did you have `libjpeg` or `libpng` installed before building `torchvision` from source?
  warn(
> /root/LLaMA-Factory/src/llamafactory/hparams/parser.py(372)get_infer_args()
-> model_args, data_args, finetuning_args, generating_args = _parse_infer_args(args)
(Pdb) c
Traceback (most recent call last):
  File "vllm_infer.py", line 144, in <module>
    fire.Fire(vllm_infer)
  File "/opt/conda/lib/python3.8/site-packages/fire/core.py", line 135, in Fire
    component_trace = _Fire(component, args, parsed_flag_args, context, name)
  File "/opt/conda/lib/python3.8/site-packages/fire/core.py", line 468, in _Fire
    component, remaining_args = _CallAndUpdateTrace(
  File "/opt/conda/lib/python3.8/site-packages/fire/core.py", line 684, in _CallAndUpdateTrace
    component = fn(*varargs, **kwargs)
  File "vllm_infer.py", line 58, in vllm_infer
    model_args, data_args, _, generating_args = get_infer_args(
  File "/root/LLaMA-Factory/src/llamafactory/hparams/parser.py", line 372, in get_infer_args
    model_args, data_args, finetuning_args, generating_args = _parse_infer_args(args)
  File "/root/LLaMA-Factory/src/llamafactory/hparams/parser.py", line 152, in _parse_infer_args
    return _parse_args(parser, args)
  File "/root/LLaMA-Factory/src/llamafactory/hparams/parser.py", line 57, in _parse_args
    return parser.parse_dict(args)
  File "/opt/conda/lib/python3.8/site-packages/transformers/hf_argparser.py", line 377, in parse_dict
    raise ValueError(f"Some keys are not used by the HfArgumentParser: {sorted(unused_keys)}")
ValueError: Some keys are not used by the HfArgumentParser: ['vllm_config']

[hiyouga]

update llamafactory