-
Notifications
You must be signed in to change notification settings - Fork 405
Open
Labels
Description
Describe the bug
A clear and concise description of what the bug is.
Every question, it returns the following:
File "<string>", line 1, in <module>
from multiprocessing.spawn import spawn_main; spawn_main(parent_pid=17480, pipe_handle=1604)
~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\chigo\AppData\Local\Programs\Python\Python313\Lib\multiprocessing\spawn.py", line 113, in spawn_main
new_handle = reduction.duplicate(pipe_handle,
source_process=source_process)
File "C:\Users\chigo\AppData\Local\Programs\Python\Python313\Lib\multiprocessing\reduction.py", line 79, in duplicate
return _winapi.DuplicateHandle(To Reproduce
Please provide all the steps needed to reproduce the behavior, or provide a minimal working example if needed. We will ignore issues missing this section.
set OPENAI_BASE_URL=http://localhost:11434/v1
set OPENAI_API_KEY=apikey
lighteval eval --timeout 600 --max-connections 1 --max-tasks 1 openai/gpt-oss:20b gsm8kExpected behavior
A clear and concise description of what you expected to happen.
It should run without printing the warning every question.
Version info
Please provide your operating system, lighteval version or commit if you installed from main, and pip/conda environment if your problem concerns dependencies.
Windows 10
commit 6496d62
uv 0.8.13