#

exllamav3

Here is 1 public repository matching this topic...

Bobcat / llm-pool

FastAPI LLM pool for local and OpenAI-compatible remote inference, with multimodal input, scheduling, replicas, metrics, and admin APIs.

openai mtp llama-cpp vllm ctranslate2 exllamav3 vision-mtp

Updated Jun 26, 2026
Python

Improve this page

Add a description, image, and links to the exllamav3 topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the exllamav3 topic, visit your repo's landing page and select "manage topics."