[Feature] Dynamic Lora Support in SGLang (like VLLM)

[grahama1970]

Checklist

• 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
• 2. Please use English, otherwise it will be closed.

Motivation

In SGLang, I would to dynamically apply domain-specific Lora adapters to smaller/local models. Normally, I use SGLang for inference. Recently, I've switched to Vllm which already has the ability to unload/load adaptors: https://docs.vllm.ai/en/latest/usage/lora.html
If this feature is already exists in SGlang, can you add an example in the documentation?

Related resources

https://docs.vllm.ai/en/latest/usage/lora.html

[zhaochenyang20]

@Ying1123 and @Wenyueh is on this. Thanks!