RuntimeError: Error(s) in loading state_dict for ControlLDM: Unexpected key(s) in state_dict: "cond_stage_model.transformer.text_model.embeddings.position_ids".

[LukeLIN-web]

Loaded state_dict from [./models/control_sd15_canny.pth]
Traceback (most recent call last):
File "/home/juyi/ControlNet/gradio_canny2image.py", line 21, in
model.load_state_dict(load_state_dict('./models/control_sd15_canny.pth', location='cuda'))
File "/home/juyi/miniconda3/envs/viditq/lib/python3.10/site-packages/torch/nn/modules/module.py", line 2152, in load_state_dict
raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for ControlLDM:
Unexpected key(s) in state_dict: "cond_stage_model.transformer.text_model.embeddings.position_ids".

[ButoneDream]

me too

[ButoneDream]

Traceback (most recent call last):
File "gradio_pose2image.py", line 21, in
model.load_state_dict(load_state_dict('./models/control_sd15_openpose.pth', location='cuda'))
File "/data/zhoulei/anaconda3/envs/control/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1671, in load_state_dict
raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for ControlLDM:
Unexpected key(s) in state_dict: "cond_stage_model.transformer.text_model.embeddings.position_ids".

[yousaLING]

Hi, maybe you should degrade the vision of transformers to 4.19.2.