You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
size mismatch for pos_embed: copying a param with shape torch.Size([1, 4096, 2240]) from checkpoint, the shape in current model is torch.Size([1, 1024, 2240]).
#112
Open
shaun-ba opened this issue
Dec 27, 2024
· 2 comments
@city96 Don't suppose this is a simple fix I could patch in? Trying to load the 2k model, I see you have some configs for it so thought it may just work. Not sure where the 4096 is coming from.
The text was updated successfully, but these errors were encountered:
@city96 Don't suppose this is a simple fix I could patch in? Trying to load the 2k model, I see you have some configs for it so thought it may just work. Not sure where the 4096 is coming from.
The text was updated successfully, but these errors were encountered: