Reproduction and exploration of QBB-based low-bit LLM quantization on TinyLlama, with 2-bit/4-bit experiments and WikiText-2 PPL evaluation.
-
Updated
Apr 5, 2026 - Python
Reproduction and exploration of QBB-based low-bit LLM quantization on TinyLlama, with 2-bit/4-bit experiments and WikiText-2 PPL evaluation.
A custom BERT2BERT transformer for text summarization, built in MLX for full MacBook compatibility for both training and inference.
Reproducible LoRA useful-rank diagnostics from activation-whitened early-gradient spectra, with theory, controlled simulations, GPT-2/WikiText-2 validation, and Zenodo data artifacts.
HLSTM Model
Add a description, image, and links to the wikitext-2 topic page so that developers can more easily learn about it.
To associate your repository with the wikitext-2 topic, visit your repo's landing page and select "manage topics."