You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
when I use the tokenizer, the error occurs:
Info:File "/home/z/anaconda3/envs/t2v/lib/python3.9/site-packages/transformers/tokenization_utils_base.py", line 3737, in _pad
encoded_inputs["attention_mask"] = encoded_inputs["attention_mask"] + [0] * difference
!:OverflowError: cannot fit 'int' into an index-sized integer
I check the value of "difference" = 1000000000000000019884624838647
The text was updated successfully, but these errors were encountered:
when I use the tokenizer, the error occurs:
Info:File "/home/z/anaconda3/envs/t2v/lib/python3.9/site-packages/transformers/tokenization_utils_base.py", line 3737, in _pad
encoded_inputs["attention_mask"] = encoded_inputs["attention_mask"] + [0] * difference
!:OverflowError: cannot fit 'int' into an index-sized integer
I check the value of "difference" = 1000000000000000019884624838647
The text was updated successfully, but these errors were encountered: