Skip to content

[BUG] return _winapi.DuplicateHandle #1108

@chigkim

Description

@chigkim

Describe the bug

A clear and concise description of what the bug is.

Every question, it returns the following:

  File "<string>", line 1, in <module>
    from multiprocessing.spawn import spawn_main; spawn_main(parent_pid=17480, pipe_handle=1604)
                                                  ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\chigo\AppData\Local\Programs\Python\Python313\Lib\multiprocessing\spawn.py", line 113, in spawn_main
    new_handle = reduction.duplicate(pipe_handle,
                                     source_process=source_process)
  File "C:\Users\chigo\AppData\Local\Programs\Python\Python313\Lib\multiprocessing\reduction.py", line 79, in duplicate
    return _winapi.DuplicateHandle(

To Reproduce

Please provide all the steps needed to reproduce the behavior, or provide a minimal working example if needed. We will ignore issues missing this section.

set OPENAI_BASE_URL=http://localhost:11434/v1
set OPENAI_API_KEY=apikey
lighteval eval --timeout 600 --max-connections 1 --max-tasks 1 openai/gpt-oss:20b gsm8k

Expected behavior

A clear and concise description of what you expected to happen.

It should run without printing the warning every question.

Version info

Please provide your operating system, lighteval version or commit if you installed from main, and pip/conda environment if your problem concerns dependencies.

Windows 10
commit 6496d62
uv 0.8.13

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions