Skip to content
This repository has been archived by the owner on Oct 11, 2024. It is now read-only.

Add Open Port #389

Closed
wants to merge 1 commit into from
Closed

Add Open Port #389

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion vllm/entrypoints/openai/rpc/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,8 +6,9 @@
from vllm.lora.request import LoRARequest
from vllm.prompt_adapter.request import PromptAdapterRequest
from vllm.sampling_params import SamplingParams
from vllm.utils import get_open_port

VLLM_RPC_PATH = "tcp://localhost:5570"
VLLM_RPC_PATH = f"tcp://localhost:{get_open_port()}"
VLLM_RPC_SUCCESS_STR = "SUCCESS"


Expand Down
Loading