Highlights
- Add paged kv implement
- Support switch model in chat page
What's Changed
- chore(version): upgrade mlx to 0.30.0 which has arm64 wheel by @gufengc in #284
- chore(version): Revert upgrade mlx to 0.30.0 which has arm64 wheel by @gufengc in #285
- refactor(test): refactor test_executor for mix backend by @TianyiZhao1437 in #287
- chore(lattica): upgrade lattica to 1.0.14 to support lower glibc by @gufengc in #288
- refactor(executor): Separate executor code with different backends by @TianyiZhao1437 in #291
- feat(backend): add mac lora function by @wasamtc in #283
- feat(backend): switch model by @JasonOE in #289
- feat(pagedkv): Add paged kv implement by @yuhao-zh in #278
- chore(version): update version to 0.1.2 by @sl-gn in #300
Full Changelog: v0.1.1...v0.1.2
Contributors
wasamtc, JasonOE, and 4 other contributors