You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello, and thank you for your excellent work! I am currently working on training a downstream task using LISA, but I’m unsure about the correct approach for training on the pretrained LISA model.
I’ve attempted to use your pretrained LISA model as the Llama2 model, and I've also implemented SAM ViT-H pretrained weights. Here’s the command I used:
However, I noticed that the model's performance isn’t very good after training for 5 epochs, which makes me wonder if I have correctly set up training with your pretrained model.
Could you please confirm if this setup is correct or suggest any modifications? Thank you!
The text was updated successfully, but these errors were encountered:
I checked and compared the train_ds.py and chat.py and find that the training code might have to be modified to load the llama and SAM from one source together, like that in inference.
Hello, and thank you for your excellent work! I am currently working on training a downstream task using LISA, but I’m unsure about the correct approach for training on the pretrained LISA model.
I’ve attempted to use your pretrained LISA model as the Llama2 model, and I've also implemented SAM ViT-H pretrained weights. Here’s the command I used:
However, I noticed that the model's performance isn’t very good after training for 5 epochs, which makes me wonder if I have correctly set up training with your pretrained model.
Could you please confirm if this setup is correct or suggest any modifications? Thank you!
The text was updated successfully, but these errors were encountered: