Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When you update the code, fine-tuning Llama 3.2 Vision (11B) will encounter a bug. #1474

Open
EricZhou0221 opened this issue Dec 26, 2024 · 3 comments

Comments

@EricZhou0221
Copy link

微信图片_20241226180010

@viktor436
Copy link

viktor436 commented Dec 26, 2024

Just run it without the nightly update. I suspect the error is form the last commit that adds the fast_lora_forwards (cebdfcf). Change the first code cell like that:

!pip install unsloth
# Also get the latest nightly Unsloth!
# !pip uninstall unsloth -y && pip install --upgrade --no-cache-dir --no-deps git+https://github.com/unslothai/unsloth.git```

@danielhanchen
Copy link
Contributor

Apologies! I was preparing for some stuff, but I guess I pushed it into main whoops - I fixed it now - restarting Colab / Kaggle will work, or on local machines, please do pip uninstall unsloth_zoo unsloth -y && pip install --upgrade --no-cache-dir --no-deps unsloth_zoo unsloth

@EricZhou0221
Copy link
Author

Apologies! I was preparing for some stuff, but I guess I pushed it into main whoops - I fixed it now - restarting Colab / Kaggle will work, or on local machines, please do pip uninstall unsloth_zoo unsloth -y && pip install --upgrade --no-cache-dir --no-deps unsloth_zoo unsloth

Thank you! The issue has been resolved after the latest update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants