Pinned Loading

1. vllm-gptq vllm-gptq Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 131 14

2. exl2-for-all exl2-for-all Public

   EXL2 quantization generalized to other models.

   Python 10 3

3. QuIP-for-all QuIP-for-all Public

   QuIP quantization

   Python 51 5

4. llama-cpp-torch llama-cpp-torch Public

   llama.cpp to PyTorch Converter

   Cuda 33 6