Skip to content

GPU acceleration is broken in docker image #2799

Description

@klkr1

Platform

Linux/Ubuntu

Lemonade Version

11.5.0

GPU / APU Model

Radeon RX 6600 XT

Component

Other / Not sure

Bug Description

backends in docker image do not use GPU but CPU instead even if vulkan or rocm backend is configured

Steps to Reproduce

pull docker image
run container with --device=/dev/dfk --device=/dev/dri
start chat

Expected vs Actual Behavior

Expected: GPU acceleration is used
Actual: Log shows only CPU device
rocminfo inside of docker shows Permission denied for /dev/kfd and /dev/dri

Log Output

Additional Context

user lemonade is not member of video and render group:
/etc/group:
video:x:44:ubuntu

undefined group for /dev/kfd:
crw-rw---- 1 root 148 236, 0 Jul 23 18:21 /dev/kfd

adding user lemonade to groups video and render and adding group render with gid 148 solves the issue

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingengine::llamacppllama.cpp backend (LlamaCppServer); GPU/CPU LLM inference (Vulkan, ROCm, Metal)runtime::rocmAMD ROCm runtime

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions