-
Notifications
You must be signed in to change notification settings - Fork 939
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Skill Knowhow: Refining skills #172
Comments
See also instructlab/instructlab#398 |
Hi @obuzek It would be helpful for the first time contributers if you could please provide references to the docs you've mentioned above (skill info, skill development & triage info docs) I've taken this opportunity to provide the references, kindly update if they are incorrect skill info doc : SKILLS_GUIDE.md |
The Community Learning Guide covers some relevant topics, but not yet this one. Automatic generation in response to PRs is getting added soon, which may help people with this. Leaving this open since this remains relevant information. |
This issue has been automatically marked as stale because it has not had activity within 60 days. It will be automatically closed if no further activity occurs within 31 days. |
We need better documentation on ensuring that the skills you contribute will actually improve the model.
People have reported their
generate_.jsonl
andtrain_.jsonl
files (as a result of runninglab generate
) contain relatively inaccurate alternate instruction suggestions. We'll likely get a better skill tree if people learn to look at these outputs, and refine the verbiage of their skills until they're getting strong answers from the teacher model (the one you load up withlab serve
before you runlab generate
).@xukai92's commentary:
Tasks
.jsonl
output has improved will be more beneficial to the modelThe text was updated successfully, but these errors were encountered: