Skip to content

Enforcing NIXLv2 As default, no support for no connectors #399

@elevran

Description

@elevran

Found today testing with vanilla gpu preset. The code defaults to NIXL V2. This would cause issues for someone who just wants to run vllm with P/D routing but no NIXL. System should support no connectors if desired, especially for plug and play compatibility with upstream vllm

(copied from llm-d/llm-d-routing-sidecar#25)

Metadata

Metadata

Assignees

No one assigned

    Labels

    component/sidecarneeds-triageIndicates an issue or PR lacks a `triage/foo` label and requires one.

    Type

    No type

    Projects

    Status

    Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions