Skip to content

Commit

Permalink
[Docs] fix format of the dist kv cache doc (#714)
Browse files Browse the repository at this point in the history
Signed-off-by: Dwyane Shi <[email protected]>
  • Loading branch information
DwyaneShi authored Feb 19, 2025
1 parent 0a21d77 commit faaf595
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions docs/source/features/distributed-kv-cache.rst
Original file line number Diff line number Diff line change
Expand Up @@ -67,10 +67,10 @@ After launching AIBrix's deployment, we can use the following yaml to deploy a d
2. ``kvcache.orchestration.aibrix.ai/node-affinity-gpu-type`` is unnecessary unless you deploy the model across different GPUs.


Run ``kubectl get pods`` to verify all pods are running.
Run ``kubectl get pods -o wide`` to verify all pods are running.

.. code-block:: RST
.. note::
kubectl get pods -o wide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
deepseek-coder-7b-instruct-85664648c7-xgp9h 1/1 Running 0 2m41s 192.168.59.224 ip-192-168-41-184.us-west-2.compute.internal <none> <none>
deepseek-coder-7b-kvcache-7d5896cd89-dcfzt 1/1 Running 0 2m31s 192.168.37.154 ip-192-168-41-184.us-west-2.compute.internal <none> <none>
Expand Down

0 comments on commit faaf595

Please sign in to comment.