Skip to content

Pull requests: huggingface/lighteval

New pull request New
35 Open 446 Closed
35 Open 446 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix(openai): improve tokenizer fallback and remove env_config param
#786 opened May 27, 2025 by ryantzr1 Loading…
1
fix: update python api user docs
#784 opened May 27, 2025 by ryantzr1 Loading…
1
1
Add org_to_bill parameter to documentation
#781 opened May 26, 2025 by tfrere Loading…
1
Complete TranslationLiterals for Language.ESTONIAN
#779 opened May 23, 2025 by spyysalo Loading…
1
Update translation_literals.py with icelandic
#775 opened May 22, 2025 by joenaess Loading…
Add support for vLLM KV-cache quantization
#773 opened May 22, 2025 by eldarkurtic Loading…
1
Add TranslationLiterals for Language.DANISH
#770 opened May 22, 2025 by spyysalo Loading…
1
Add Bulgarian and Macedonian literals
#769 opened May 22, 2025 by dianaonutu Loading…
1
Add Romanian literals feature/enhancement New feature/request
#764 opened May 21, 2025 by dianaonutu Loading…
3
Newer openai and loosened httpx
#758 opened May 21, 2025 by jamesbraza Loading…
1
4
Add Chinese (zh) Translation of Documentation documentation Improvements or additions to documentation
#744 opened May 19, 2025 by CassiopeiaCode Loading…
12
Adds RULER benchmark new-task
#722 opened May 15, 2025 by NathanHB Loading…
1
12
Revert the task detail serialization to be compliant with PyArrow
#715 opened May 11, 2025 by alvin319 Loading…
1
6
update for CB
#714 opened May 9, 2025 by ArthurZucker Loading…
1
4
refacto prompt building
#709 opened May 7, 2025 by NathanHB Loading…
1
[WIP] Fix nanotron compatibility
#706 opened May 6, 2025 by duynht Loading…
3
Add way to load local datafile feature/enhancement New feature/request
#687 opened Apr 24, 2025 by ScottHoang Loading…
1
2
Nanotron model updates feature/enhancement New feature/request
#652 opened Mar 31, 2025 by anton-l Loading…
1
Add CLI arg generate_until_token to support reasoning and CoT models
#617 opened Mar 17, 2025 by mapmeld Loading…
1
2
added vllm lora support. feature/enhancement New feature/request
#611 opened Mar 11, 2025 by haizhou-shi Loading…
4
Add draft functionality for a generic sandboxed code running
#580 opened Feb 21, 2025 by plaguss • Draft
1 of 2 tasks
2
Add CodeElo new-task
#575 opened Feb 19, 2025 by plaguss • Draft
1
new metrics and pr-fouras dataset add
#558 opened Feb 13, 2025 by BertrandCabotIDRIS Loading…
4
Adding verbal-reasoning-challenge as a Community Task
#551 opened Feb 11, 2025 by aryawu0513 Loading…
9
Improved stability of litellm models for reasoning models.
#538 opened Feb 5, 2025 by JoelNiklaus Loading…
8
ProTip! What’s not been updated in a month: updated:<2025-04-29.