Repositories list

• LMCache

  Public
  LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

  fastamdcuda+ 7

  fastamdcudainferencepytorchspeedrocmkv-cachellmvllm

  Python

  •

  Apache License 2.0

  •1.6k1.6k forks•11k11k stars•128128 issues•275275 pull requests•Updated Jul 15, 2026Jul 15, 2026

• LMCache-Ascend

  Public
  LMCache on Ascend

  Python

  •

  Apache License 2.0

  •4141 forks•8080 stars•4949 issues•99 pull requests•Updated Jul 14, 2026Jul 14, 2026

• vllm-cpu

  Public
  CPU only nightly vllm wheels

  Shell

  •00 forks•00 stars•00 issues•00 pull requests•Updated Jun 17, 2026Jun 17, 2026

• opt-125m

  Public
  Other

  •00 forks•00 stars•00 issues•00 pull requests•Updated Jun 17, 2026Jun 17, 2026

• kvcache-view

  Public
  KV cache visualizations

  HTML

  •

  Other

  •11 fork•88 stars•00 issues•00 pull requests•Updated May 19, 2026May 19, 2026

• lmcache_frontend

  Public
  the frontend of lmcache

  Python

  •66 forks•1717 stars•55 issues•00 pull requests•Updated Apr 22, 2026Apr 22, 2026

• lmcache-agent-trace

  Public
  Agent application/benchmark/workload traces should be placed here.

  Python

  •

  Apache License 2.0

  •66 forks•1414 stars•00 issues•11 pull request•Updated Apr 13, 2026Apr 13, 2026

• LMBenchmark

  Public
  Systematic and comprehensive benchmarks for LLM systems.

  Python

  •

  Apache License 2.0

  •2626 forks•6262 stars•22 issues•00 pull requests•Updated Jan 28, 2026Jan 28, 2026

• lmcache_redis

  Public
  zero copy python sdk

  Python

  •11 fork•11 star•00 issues•11 pull request•Updated Jan 21, 2026Jan 21, 2026

• LMBench

  Public
  Modular Serving Engine x Workload Generator Benchmarking Tool

  Python

  •

  Apache License 2.0

  •33 forks•1111 stars•55 issues•00 pull requests•Updated Nov 19, 2025Nov 19, 2025

• lmcache.github.io

  Public
  LMCache official blog

  HTML

  •

  MIT License

  •66 forks•11 star•00 issues•00 pull requests•Updated Oct 29, 2025Oct 29, 2025

• demo-baseline-benchmarking

  Public
  JavaScript

  •00 forks•11 star•00 issues•00 pull requests•Updated Sep 26, 2025Sep 26, 2025

• lmcache-agentic

  Public
  Python

  •00 forks•55 stars•00 issues•00 pull requests•Updated Sep 8, 2025Sep 8, 2025

• LMIgnite

  Public
  Shell

  •

  Apache License 2.0

  •44 forks•2828 stars•00 issues•00 pull requests•Updated Jul 29, 2025Jul 29, 2025

• hardware-diagnostic

  Public
  View Information about hardware

  Python

  •00 forks•44 stars•00 issues•00 pull requests•Updated Jul 25, 2025Jul 25, 2025

• LMCache-Examples

  Public
  Jupyter Notebook

  •22 forks•66 stars•00 issues•00 pull requests•Updated Jul 9, 2025Jul 9, 2025

• inference-engine-arena

  Public
  Postman & Chatbot Arena for inference benchmarking.

  Python

  •

  Apache License 2.0

  •11 fork•11 star•00 issues•00 pull requests•Updated May 14, 2025May 14, 2025

• demo

  Public
  Python

  •

  Apache License 2.0

  •1111 forks•3131 stars•55 issues•11 pull request•Updated Apr 17, 2025Apr 17, 2025

• lmcache-tests

  Public
  Python

  •

  Apache License 2.0

  •88 forks•99 stars•88 issues•22 pull requests•Updated Apr 2, 2025Apr 2, 2025

• lmcache-vllm

  Public
  The driver for LMCache core to run in vLLM

  Python

  •

  Apache License 2.0

  •3838 forks•6868 stars•55 issues•66 pull requests•Updated Feb 4, 2025Feb 4, 2025

• torchac_cuda

  Public
  Cuda

  •

  Apache License 2.0

  •77 forks•55 stars•22 issues•44 pull requests•Updated Jan 30, 2025Jan 30, 2025

• lmcache-server

  Public
  Python

  •

  Apache License 2.0

  •66 forks•66 stars•00 issues•00 pull requests•Updated Sep 17, 2024Sep 17, 2024