LLM2Vec fails

[Muennighoff]

Name: transformers
Version: 4.46.1
Summary: State-of-the-art Machine Learning for JAX, PyTorch and TensorFlow
Home-page: https://github.com/huggingface/transformers
Author: The Hugging Face team (past and future) with the help of all our contributors (https://github.com/huggingface/transformers/graphs/contributors)
Author-email: [email protected]
License: Apache 2.0 License
Location: /data/env/lib/conda/gritkto/lib/python3.10/site-packages
Requires: filelock, huggingface-hub, numpy, packaging, pyyaml, regex, requests, safetensors, tokenizers, tqdm
Required-by: ai2-olmo, bert-score, bigcode_eval, compressed-tensors, FlagEmbedding, gritlm, langchain-huggingface, llm2vec, llm_blender, lm_eval, peft, rewardbench, sentence-transformers, trl, vllm

2024-12-30 17:05:02.979627: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:485] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-12-30 17:05:02.992945: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:8454] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-12-30 17:05:02.996861: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1452] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
INFO:mteb.cli:Running with parameters: Namespace(model='McGill-NLP/LLM2Vec-Meta-Llama-3-8B-Instruct-mntp-supervised', task_types=None, categories=None, tasks=['LEMBPasskeyRetrieval'], languages=None, benchmarks=None, device=None, output_folder='/data/niklas/results/results', verbosity=2, co2_tracker=True, eval_splits=None, model_revision=None, batch_size=64, overwrite=False, save_predictions=False, func=<function run at 0x7fbe9ba615a0>)

Downloading shards:   0%|          | 0/4 [00:00<?, ?it/s]
Downloading shards:  25%|██▌       | 1/4 [00:00<00:00,  4.77it/s]
Downloading shards:  75%|███████▌  | 3/4 [00:00<00:00, 10.38it/s]
Downloading shards: 100%|██████████| 4/4 [00:00<00:00, 10.26it/s]

Loading checkpoint shards:   0%|          | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards:  25%|██▌       | 1/4 [00:01<00:04,  1.45s/it]
Loading checkpoint shards:  50%|█████     | 2/4 [00:02<00:02,  1.30s/it]
Loading checkpoint shards:  75%|███████▌  | 3/4 [00:03<00:01,  1.27s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:04<00:00,  1.13it/s]
Loading checkpoint shards: 100%|██████████| 4/4 [00:04<00:00,  1.04s/it]
INFO:mteb.evaluation.MTEB:

## Evaluating 1 tasks:
─────────────────────────────── Selected tasks  ────────────────────────────────
Retrieval
    - LEMBPasskeyRetrieval, s2p


INFO:mteb.evaluation.MTEB:

********************** Evaluating LEMBPasskeyRetrieval **********************
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-5456db0b4acf3809.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-5456db0b4acf3809.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-c4cb77e03ae93e57.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-c4cb77e03ae93e57.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-5a2be7a1ed617314.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-5a2be7a1ed617314.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-587e55298efffd29.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-587e55298efffd29.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-c91070a21115f89a.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-c91070a21115f89a.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-ce6c96ddddebb130.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-ce6c96ddddebb130.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-5b96f06df57ef6cc.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-5b96f06df57ef6cc.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-87c30eb04728b840.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-87c30eb04728b840.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-19f7334c5f0d9f06.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-19f7334c5f0d9f06.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-77d5aba17278ec46.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-77d5aba17278ec46.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-ccc05f73ae7ff9ec.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-ccc05f73ae7ff9ec.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-5a9f395edeb3e6c5.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-5a9f395edeb3e6c5.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-61f20c4914148413.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-61f20c4914148413.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-0b8c0b77c731c247.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-0b8c0b77c731c247.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-0e4b57a023baccc8.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-0e4b57a023baccc8.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-36661c333ac1c5e7.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-36661c333ac1c5e7.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-59da39983da1f922.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-59da39983da1f922.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-140a711bef582d6d.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-140a711bef582d6d.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-3d9c018e03361424.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-3d9c018e03361424.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-3c1ba99d8156257e.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-3c1ba99d8156257e.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-80adc4cbd544df45.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-80adc4cbd544df45.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-49f16fe0275c6f5d.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-49f16fe0275c6f5d.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-d3872df6d7d8f27d.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-d3872df6d7d8f27d.arrow
Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
INFO:datasets.info:Loading Dataset Infos from /env/lib/conda/gritkto/lib/python3.10/site-packages/datasets/packaged_modules/json
Overwrite dataset info from restored data version if exists.
INFO:datasets.builder:Overwrite dataset info from restored data version if exists.
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
INFO:datasets.builder:Found cached dataset long_embed (/data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c)
Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
INFO:datasets.info:Loading Dataset info from /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c
Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-f8cfb280fc8de57f.arrow
INFO:datasets.arrow_dataset:Loading cached processed dataset at /data/huggingface/datasets/dwzhu___long_embed/passkey/0.0.0/6e346642246bfb4928c560ee08640dc84d074e8c/cache-f8cfb280fc8de57f.arrow
INFO:mteb.abstasks.AbsTaskRetrieval:Subset: default
INFO:mteb.evaluation.evaluators.RetrievalEvaluator:Encoding Queries.

Batches:   0%|          | 0/1 [00:00<?, ?it/s]
Batches:   0%|          | 0/1 [00:00<?, ?it/s]
ERROR:mteb.evaluation.MTEB:Error while evaluating LEMBPasskeyRetrieval: 'LlamaBiModel' object has no attribute 'rotary_emb'
Traceback (most recent call last):
  File "/env/lib/conda/gritkto/bin/mteb", line 8, in <module>
    sys.exit(main())
  File "/data/niklas/mteb/mteb/cli.py", line 387, in main
    args.func(args)
  File "/data/niklas/mteb/mteb/cli.py", line 145, in run
    eval.run(
  File "/data/niklas/mteb/mteb/evaluation/MTEB.py", line 623, in run
    raise e
  File "/data/niklas/mteb/mteb/evaluation/MTEB.py", line 562, in run
    results, tick, tock = self._run_eval(
  File "/data/niklas/mteb/mteb/evaluation/MTEB.py", line 304, in _run_eval
    results = task.evaluate(
  File "/data/niklas/mteb/mteb/abstasks/AbsTaskRetrieval.py", line 339, in evaluate
    scores[hf_subset] = self._evaluate_subset(
  File "/data/niklas/mteb/mteb/abstasks/AbsTaskRetrieval.py", line 348, in _evaluate_subset
    results = retriever(corpus, queries)
  File "/data/niklas/mteb/mteb/evaluation/evaluators/RetrievalEvaluator.py", line 478, in __call__
    return self.retriever.search(
  File "/data/niklas/mteb/mteb/evaluation/evaluators/RetrievalEvaluator.py", line 123, in search
    query_embeddings = self.model.encode(
  File "/data/niklas/mteb/mteb/evaluation/evaluators/RetrievalEvaluator.py", line 417, in encode
    return self.model.encode(
  File "/data/niklas/mteb/mteb/models/llm2vec_models.py", line 69, in encode
    return self.model.encode(sentences, **kwargs)
  File "/env/lib/conda/gritkto/lib/python3.10/site-packages/llm2vec/llm2vec.py", line 361, in encode
    embeddings = self._encode(
  File "/env/lib/conda/gritkto/lib/python3.10/site-packages/llm2vec/llm2vec.py", line 447, in _encode
    embeddings = self.forward(features)
  File "/env/lib/conda/gritkto/lib/python3.10/site-packages/llm2vec/llm2vec.py", line 227, in forward
    reps = self.model(**sentence_feature)
  File "/env/lib/conda/gritkto/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/env/lib/conda/gritkto/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)
  File "/env/lib/conda/gritkto/lib/python3.10/site-packages/peft/peft_model.py", line 538, in forward
    return self.get_base_model()(*args, **kwargs)
  File "/env/lib/conda/gritkto/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1553, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/env/lib/conda/gritkto/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1562, in _call_impl
    return forward_call(*args, **kwargs)
  File "/env/lib/conda/gritkto/lib/python3.10/site-packages/transformers/models/llama/modeling_llama.py", line 921, in forward
    position_embeddings = self.rotary_emb(hidden_states, position_ids)
  File "/env/lib/conda/gritkto/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1729, in __getattr__
    raise AttributeError(f"'{type(self).__name__}' object has no attribute '{name}'")
AttributeError: 'LlamaBiModel' object has no attribute 'rotary_emb'