New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

对qwen-2.5扩充词表后loss飙升 #360

Open

QianguoS opened this issue Oct 9, 2024 · 1 comment

QianguoS commented Oct 9, 2024

对qwen-2.5扩充词表后loss飙升到2000，可以帮忙看下问题吗

Collaborator

jerryli1981 commented Oct 24, 2024

您好，扩充的部分是不是需要特殊的初始化方案，可以进群at我们详聊下，谢谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment