Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

学生模型权重初始化问题 #121

Open
cgh-code777 opened this issue Dec 27, 2023 · 2 comments
Open

学生模型权重初始化问题 #121

cgh-code777 opened this issue Dec 27, 2023 · 2 comments

Comments

@cgh-code777
Copy link

老师您好，请问怎么用教师模型的权重参数去初始化学生模型呢，比如用教师模型的前六层去初始化学生的参数。
@stale Stale
Copy link

stale bot commented Mar 17, 2024

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the stale label Mar 17, 2024
@free2ride19
Copy link

open issue - marked as seen

@stale stale bot removed the stale label Mar 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@cgh-code777 @free2ride19