Skip to content

fix: pass inference server Entrypoint as a string array - #4681

Open
DeveloperNo579212 wants to merge 1 commit into
containers:mainfrom
DeveloperNo579212:fix/inference-server-entrypoint-array
Open

fix: pass inference server Entrypoint as a string array#4681
DeveloperNo579212 wants to merge 1 commit into
containers:mainfrom
DeveloperNo579212:fix/inference-server-entrypoint-array

Conversation

@DeveloperNo579212

Copy link
Copy Markdown

What does this PR do?

Pass the llama.cpp inference container Entrypoint as a string array instead of a string.

On WSL with NVIDIA GPU, creating a model service sent "Entrypoint":"/usr/bin/sh". Podman's container create API decodes Entrypoint as []string, so a JSON string fails with HTTP 400 (decode slice: expect [ or n, but found ").

Screenshot / video of UI

N/A

What issues does this PR fix or reference?

Fixes #4679

How to test this PR?

  • Unit tests cover the WSL NVIDIA GPU create-container options (Entrypoint: ['/usr/bin/sh'])
  • On Windows with a WSL Podman machine and experimental GPU enabled, create a model service and confirm the inference server starts without the HTTP 400 Entrypoint error

Podman's container create API decodes Entrypoint as []string, so a JSON
string such as "/usr/bin/sh" fails with HTTP 400. Use an array for the
WSL NVIDIA GPU llama.cpp container.

Fixes containers#4679

Co-authored-by: Cursor <cursoragent@cursor.com>
Signed-off-by: momma <mikael.omma@trimble.se>
@DeveloperNo579212
DeveloperNo579212 marked this pull request as draft August 17, 2026 09:06
@DeveloperNo579212
DeveloperNo579212 marked this pull request as ready for review August 17, 2026 09:08
@bmahabirbu

Copy link
Copy Markdown
Contributor

are u a real person

@DeveloperNo579212

Copy link
Copy Markdown
Author

thanks for asking, I confirm presence of skin,blood and bones.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ai-lab:1.9.3 fails with Creating Model service with Podman Desktop 1.29.1

2 participants