Skip to content

Issues: microsoft/LoRA

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

69 Open 38 Closed
69 Open 38 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[FATAL BUG REPORT] with torch.no_grad(): can not close the gradient of lora matrix
#185 opened Nov 8, 2024 by bjzhb666
5
Understanding Figure 3
#184 opened Oct 20, 2024 by Davidyao99
How are the pretrained weigts set to be fixed during training?
#181 opened Jul 26, 2024 by HaiminZhang
1
Questions about replicating NLU experiments
#177 opened Jun 22, 2024 by lky-violet
Questions about running the cola dataset script
#176 opened May 21, 2024 by dengxingzhi
1
Where is the LoRA matrices saved?
#173 opened Apr 26, 2024 by KelsenMa
Parameter count on GPT-2 medium
#172 opened Apr 25, 2024 by Heimine
1
question for scale！
#171 opened Apr 25, 2024 by Duperr
[Question about multi-gpu training]
#170 opened Apr 10, 2024 by FindTheTruth
2
LORA on T5 model
#169 opened Apr 7, 2024 by vivektreddy
lora-dim == lora-r ?
#168 opened Mar 27, 2024 by ardand4708
After joining Lora, the first few layers show a gradient of 0
#167 opened Mar 23, 2024 by hluckye
Guidance Needed on Continuing Training with a New Dataset via LoRA
#166 opened Mar 20, 2024 by TanTaiLi
Reproduce Lora results is close but not accurate
#165 opened Mar 18, 2024 by harsh306
3
_conv_forward() error
#162 opened Mar 15, 2024 by likaiucas
Cannot implement LoRA on a custom model containing transformer encoder from pytorch
#161 opened Mar 5, 2024 by wsuSaiman
How to adjust LoRA into nn.ConvTranspose2d?
#160 opened Mar 5, 2024 by vanmeruso
2
how to improve the memory ability of lora fine tuning?
#153 opened Jan 22, 2024 by K-Alex13
1
Can not reproduce the result of Roberta-Base
#151 opened Dec 22, 2023 by Ther-nullptr
2
Layers.py not being executed
#150 opened Dec 12, 2023 by Aradhye2002
1
Can't reproduce the results for GLUE and hyperparameter misalignment
#149 opened Nov 22, 2023 by nbasyl
4
How to compute that GPT-2 M (FTTop2 ) trainable parameters number is 25.19M?
#148 opened Nov 17, 2023 by floatingbigcat
[Minor] Possible typos in weight initialization
#146 opened Nov 11, 2023 by awgu
Question about the test set of the GLUE benchmark
#145 opened Nov 1, 2023 by James6Chou
1
Question about seed numbers.
#144 opened Oct 30, 2023 by SEONHOK
ProTip! Find all open issues with in progress development work with linked:pr.