可以考虑支持下并发请求批量推理 #11

Open

opened

on Oct 27, 2025

目前同一时间只能处理一个

被Arc<Mutex>锁死了

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests