-
-
Notifications
You must be signed in to change notification settings - Fork 844
-
-
Notifications
You must be signed in to change notification settings - Fork 844
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
KeyError: "attribute 'weight' already exists" #229
Comments
I've found that the problem here is Quantization:
Model gives the error above, but it works without quantization. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I'm trying to train
RWKV/rwkv-4-world-430m
with LoRA by using Transformer's Trainer module. I've performed chunking to my data (chunk size = 128), and I initiated the training. Training continues properly, but it throws an error at the end of the epoch just before evaluating.The error is:
KeyError: "attribute 'weight' already exists"
Here is my training code and full error:
Code:
Full of error:
Please help me on this. Could be related with LoRa ?
The text was updated successfully, but these errors were encountered: