DeepSpeed with Muon Optimizer

[serser]

It seems that using muon alone (zero0) is also not working. I tested deespeed zero1, 2, all lead to the same error. Please consider supporting Muon Optimizer alongside deepseed.

swift sft
    --deepspeed zero0 \
    --optimizer muon \
...

[rank0]:   File "/root/.cache/modelscope/Moonlight/examples/toy_train.py", line 60, in zeropower_via_newtonschulz5
[rank0]:     assert len(G.shape) == 2
[rank0]:            ^^^^^^^^^^^^^^^^^
[rank0]: AssertionError