Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

如何在 llama factory 中使用多个不同难度数据集实现课程式训练(Curriculum Learning) #6350

Open
1 task done
enerai opened this issue Dec 16, 2024 · 0 comments
Labels
pending This problem is yet to be addressed

Comments

@enerai
Copy link

enerai commented Dec 16, 2024

Reminder

  • I have read the README and searched the existing issues.

System Info

.

Reproduction

我目前有三个代表不同难度级别的数据集(A、B、C),希望在 llama factory 中实现课程式学习(Curriculum Learning)的训练流程,即先用难度较低的数据集 A 进行训练,然后再依序使用难度较高的数据集 B 和 C,在同一个训练脚本中完成这一系列步骤。

想请教您以下问题:
1. 如何在同一次训练过程中按顺序加载和训练多个数据集(A → B → C)?
2. 是否有建议的实现方案或代码示例,让我可以在 llama factory 的训练流程中实现分阶段训练,并在达到一定停留条件后切换到下一个难度数据集?
3. llama factory 中是否有针对课程式学习(Curriculum Learning)的内置功能或最佳实践推荐?

如果能够提供范例、代码片段或相关参考资料,将非常感谢!谢谢您的协助!

Expected behavior

No response

Others

No response

@github-actions github-actions bot added the pending This problem is yet to be addressed label Dec 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pending This problem is yet to be addressed
Projects
None yet
Development

No branches or pull requests

1 participant