Popular repositories Loading

1. gateway-api-inference-extension gateway-api-inference-extension Public

   Forked from kubernetes-sigs/gateway-api-inference-extension

   Gateway API Inference Extension

   Go

2. llm-d-kv-cache-manager llm-d-kv-cache-manager Public

   Forked from llm-d/llm-d-kv-cache

   Distributed KV cache coordinator

   Go

3. workload-variant-autoscaler workload-variant-autoscaler Public

   Forked from llm-d/llm-d-autoscaling

   Variant optimization autoscaler for distributed inference workloads

   Go

4. llm-d-benchmark llm-d-benchmark Public

   Forked from llm-d/llm-d-benchmark

   llm-d benchmark scripts and tooling

   Python

5. llm-d llm-d Public

   Forked from llm-d/llm-d

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell

6. llm-scaler llm-scaler Public

   Forked from ev-shindin/llm-scaler

   Go