You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I followed the steps in readme but I encounted the following errors in SFT.
[WARNING] async_io requires the dev libaio .so object and headers but these were not found.
[WARNING] async_io: please install the libaio-dev package with apt
[WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
[WARNING] Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
[WARNING] sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
[WARNING] using untested triton version (2.2.0), only 1.0.0 is known to be compatible
[2024-05-19 04:59:05,039] [INFO] [comm.py:637:init_distributed] cdb=None
[2024-05-19 04:59:05,082] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2024-05-19 04:59:05,108] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[WARNING] async_io requires the dev libaio .so object and headers but these were not found.
[WARNING] async_io requires the dev libaio .so object and headers but these were not found.
[WARNING] async_io: please install the libaio-dev package with apt
[WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
[WARNING] Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
[WARNING] sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
[WARNING] using untested triton version (2.2.0), only 1.0.0 is known to be compatible
[WARNING] async_io: please install the libaio-dev package with apt
[WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
[WARNING] Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
[WARNING] sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
[WARNING] using untested triton version (2.2.0), only 1.0.0 is known to be compatible
[rank5]: Traceback (most recent call last):
[rank5]: File "/home/zhangyan/Dynathink/LongLoRA/fine-tune.py", line 211, in
[rank5]: train()
[rank5]: File "/home/zhangyan/Dynathink/LongLoRA/fine-tune.py", line 106, in train
[rank5]: model_args, training_args = parser.parse_args_into_dataclasses()
[rank5]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank5]: File "/home/zhangyan/anaconda3/envs/longlora/lib/python3.12/site-packages/transformers/hf_argparser.py", line 347, in parse_args_into_dataclasses
[rank5]: raise ValueError(f"Some specified arguments are not used by the HfArgumentParser: {remaining_args}")
[rank5]: ValueError: Some specified arguments are not used by the HfArgumentParser: [' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ']
In requirements.txt the version of torch is >=2.0.0, but the errors show that I need to install torch<2.0.0. How can I deal with the problem?
The text was updated successfully, but these errors were encountered:
I followed the steps in readme but I encounted the following errors in SFT.
[WARNING] async_io requires the dev libaio .so object and headers but these were not found.
[WARNING] async_io: please install the libaio-dev package with apt
[WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
[WARNING] Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
[WARNING] sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
[WARNING] using untested triton version (2.2.0), only 1.0.0 is known to be compatible
[2024-05-19 04:59:05,039] [INFO] [comm.py:637:init_distributed] cdb=None
[2024-05-19 04:59:05,082] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2024-05-19 04:59:05,108] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[WARNING] async_io requires the dev libaio .so object and headers but these were not found.
[WARNING] async_io requires the dev libaio .so object and headers but these were not found.
[WARNING] async_io: please install the libaio-dev package with apt
[WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
[WARNING] Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
[WARNING] sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
[WARNING] using untested triton version (2.2.0), only 1.0.0 is known to be compatible
[WARNING] async_io: please install the libaio-dev package with apt
[WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
[WARNING] Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
[WARNING] sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
[WARNING] using untested triton version (2.2.0), only 1.0.0 is known to be compatible
[rank5]: Traceback (most recent call last):
[rank5]: File "/home/zhangyan/Dynathink/LongLoRA/fine-tune.py", line 211, in
[rank5]: train()
[rank5]: File "/home/zhangyan/Dynathink/LongLoRA/fine-tune.py", line 106, in train
[rank5]: model_args, training_args = parser.parse_args_into_dataclasses()
[rank5]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[rank5]: File "/home/zhangyan/anaconda3/envs/longlora/lib/python3.12/site-packages/transformers/hf_argparser.py", line 347, in parse_args_into_dataclasses
[rank5]: raise ValueError(f"Some specified arguments are not used by the HfArgumentParser: {remaining_args}")
[rank5]: ValueError: Some specified arguments are not used by the HfArgumentParser: [' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ', ' ']
In requirements.txt the version of torch is >=2.0.0, but the errors show that I need to install torch<2.0.0. How can I deal with the problem?
The text was updated successfully, but these errors were encountered: