raise Exception("Unknown tensor name {}".format(tensor_name)) Exception: Unknown tensor name decoder.layers.0.mixer.in_proj.layer_norm_weigh

[fxnie]

Your question
Ask a clear and concise question about Megatron-LM.

[fxnie]

TOKENIZER_MODEL="/workspace/mnt/xxx/models/mamba2-2.7b/tokenizer.json"
MODEL_PATH="/workspace/mnt/xxx/ckpt/mamba2"
SAVE_PATH="/workspace/mnt/xxx/models/convert_ckpt/mamba2"

python tools/checkpoint/hybrid_conversion.py
--load-dir ${MODEL_PATH}
--save-dir ${SAVE_PATH}
--target-tp-size 2
--target-pp-size 1
--d-model 2560
--mamba-version 2
--mamba-d-state 128
--mamba2-n-groups 8
--mamba2-head-dim 32

[fxnie]