About UniProtQA Test / Validation Split

[dandingsky]

In section 3.2 of the paper you mentioned that training, validation, and test sets were randomly divided at a ratio of 8: 1: 1. However, there are 8 split files for test set of uniprot (test_0.json, ..., test_7.json). Can you clarify which of these files were used for validation/test respectively? Thanks.

[icycookies]

Thanks for your attention to our work! All the files are used for testing. Due to inference cost, we partition our test set into 8 separate files and perform inference on 8 different GPUs to accelerate testing.