v0.2.5
The juiciest bits 🚀
refactor: metric attributes by @begumcig in #81
We improved the evaluation framework for a cleaner UX: every metric is now atomic (returns a single float) with clear attributes (name, units, higher_is_better) and a unified MetricResult wrapper. All metrics consistently accept single or pairwise calls, name alignment is enforced, and the EvaluationAgent shares inference across metrics to avoid redundant computation.
refactor: remove deprecated awq algorithm by @johnrachwan123 in #143 | feat: add llm_compressor quantizer by @johnrachwan123 in #144
To continue support of the popular AWQ quantizer, we moved from auto-awq to llm_compressor.
Fixing some bugs 🐞
- fix: enhance model saving functionality to load multiple JSON configs present in diffusers by @davidberenstein1957 in #98
Full Changelog: v0.2.4...v0.2.5