You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
bash-4.4$ bash merge.sh
base model /projects/geba2844/LongLora/Llama-2-7b-hf
peft model /projects/geba2844/LongLora/Llama-2-7b-longlora-8k
Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s]
Traceback (most recent call last):
File "/projects/geba2844/LongLora/LongLoRA/merge_lora_weights_and_save_hf_model.py", line 113, in <module>
main(args)
File "/projects/geba2844/LongLora/LongLoRA/merge_lora_weights_and_save_hf_model.py", line 68, in main
model = transformers.AutoModelForCausalLM.from_pretrained(
File "/projects/geba2844/software/anaconda/envs/longlorabuild/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 565, in from_pretrained
return model_class.from_pretrained(
File "/projects/geba2844/software/anaconda/envs/longlorabuild/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3307, in from_pretrained
) = cls._load_pretrained_model(
File "/projects/geba2844/software/anaconda/envs/longlorabuild/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3681, in _load_pretrained_model
state_dict = load_state_dict(shard_file)
File "/projects/geba2844/software/anaconda/envs/longlorabuild/lib/python3.10/site-packages/transformers/modeling_utils.py", line 463, in load_state_dict
with safe_open(checkpoint_file, framework="pt") as f:
safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge
The text was updated successfully, but these errors were encountered:
Trying to run the following:
Returns the following error:
The text was updated successfully, but these errors were encountered: