Skip to content

Add NVIDIA GPU image for script agent - #20

Merged
synesthesiam merged 2 commits into
mainfrom
script-agent-gpu-image
Sep 1, 2026
Merged

synesthesiam merged 2 commits into
mainfrom
script-agent-gpu-image

Conversation

@synesthesiam

@synesthesiam synesthesiam commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add a CUDA-based Dockerfile.gpu for NVIDIA GPUs
  • expose llama.cpp GPU layer offloading through --n-gpu-layers
  • map agent CLI options to namespaced SCRIPT_AGENT_* environment variables through a container entrypoint
  • retain standard Hugging Face and NVIDIA environment variables
  • document Docker and Docker Compose usage with a LAN-reachable Home Assistant URL

Validation

  • built the GPU image locally
  • confirmed CUDA detected an NVIDIA GPU and llama.cpp reported GPU offload support
  • verified all agent-owned container settings use the SCRIPT_AGENT_* prefix
  • ran all 96 script-agent tests

synesthesiam and others added 2 commits September 1, 2026 15:23
Build llama.cpp with CUDA, expose the GPU offload setting, and provide Docker-friendly environment configuration and documentation.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Namespace agent-owned environment variables while retaining standard Hugging Face and NVIDIA variables.

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@synesthesiam
synesthesiam merged commit 6798d84 into main Sep 1, 2026
2 checks passed
@synesthesiam
synesthesiam deleted the script-agent-gpu-image branch September 1, 2026 20:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant