RuntimeError: weight model.embed_tokens.weight does not exist

[jayus71]

System Info

latest version

Information

• Docker
• The CLI directly

Tasks

• An officially supported command
• My own modifications

Reproduction

docker run --gpus all --shm-size 1g --ulimit memlock=-1 --ulimit stack=67108864
-v /media/user/data4/xxxx/mistral_models/7B-Instruct-v0.3:/model
-p 8000:80
ghcr.io/huggingface/text-generation-inference:latest
--model-id /model

Expected behavior

I want to run and load the model normally without reporting an error