-
Notifications
You must be signed in to change notification settings - Fork 83
Pull requests: huggingface/lighteval
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
A more general solution to model answer extraction instead of
output_regex
#358
opened Oct 11, 2024 by
sadra-barikbin
Loading…
[FT] adding a logprob metric with varying contexts, not choices
#253
opened Aug 8, 2024 by
clefourrier
Loading…
Considering the case empty request list is given to base model
#250
opened Aug 2, 2024 by
sadra-barikbin
Loading…
Added option for specifying model config directly, for programmatic use
#245
opened Jul 29, 2024 by
shaltielshmid
Loading…
Keep
target_for_fewshot_sorting
for another purpose
#241
opened Jul 28, 2024 by
sadra-barikbin
Loading…
Tiny improvements to
endpoint_model.py
, base_model.py
,...
#219
opened Jul 8, 2024 by
sadra-barikbin
Loading…
ProTip!
What’s not been updated in a month: updated:<2024-09-22.