Skip to content

Pull requests: huggingface/lighteval

New pull request New
13 Open 115 Closed
13 Open 115 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Make evaluator invariant of input request type order
#215 opened Jul 5, 2024 by sadra-barikbin Loading…
1
1
Add metrics as functions
#214 opened Jul 5, 2024 by clefourrier Loading…
Now only uses functions for prompt definition
#213 opened Jul 5, 2024 by clefourrier Loading…
Use only dataclasses for task init
#212 opened Jul 4, 2024 by clefourrier Loading…
1
Ar support for MBZUAI-arabic-mmlu
#209 opened Jul 3, 2024 by bakrianoo Loading…
2
[Bugfix] Avoid truncating the outputs based on string lengths
#201 opened Jun 11, 2024 by anton-l Loading…
3
Fix _init_max_length in base_model.py
#185 opened May 4, 2024 by gucci-j Loading…
9
Transformers model as Judge
#174 opened Apr 26, 2024 by anilaltuner Loading…
8
Data split depending on eval params
#169 opened Apr 22, 2024 by clefourrier Loading…
3
Nanotron tests
#160 opened Apr 19, 2024 by zzhhjjj Loading…
5
launch lighteval using lighteval --args
#152 opened Apr 10, 2024 by NathanHB Loading…
Homogeneize logging system
#150 opened Apr 8, 2024 by clefourrier Loading…
1
14
Add optimum model
#106 opened Mar 11, 2024 by echarlaix • Draft
ProTip! Updated in the last three days: updated:>2024-07-02.