RFC: Planar3 KV-cache quantization for compressed attention (experimental)#265

Open

hexxyan wants to merge 10 commits into

antirez:mainfrom

hexxyan:codex/ds4-planarquant-rfc

Commits on May 27, 2026

Add PlanarQuant-3bit RFC: 512-dim KV cache quantization prototype
hexxyan
committed
Fix PlanarQuant RFC: stride, asserts, rotation param docs
hexxyan
committed
Add Planar3 offline quality evaluator (tools/planar_eval)
hexxyan
committed
Wire Planar3 into CPU hot-path, Metal Phase 2 prep, CLI flags
hexxyan
committed
Metal Phase 2: inline Planar3 dequant in attention kernels + GPU quantize
hexxyan
committed
Wire Planar3 into Metal attention hot-path: quantize, dispatch, restore
hexxyan
committed
Fix review findings: staging, subnormals, rb16 dequant, edge-case tests
hexxyan
committed
Add Planar3→F16 dequant kernel for FlashAttention pre-stage
hexxyan
committed
Wire Planar3 dequant into FlashAttention encoder paths
hexxyan
committed
Add planar-only mode: --planar-kv-cache-only skips FP16/FP32 comp cache
hexxyan
committed