feat: speculative decoding with draft model#30

Open

cstroie wants to merge 15 commits intoRightNow-AI:mainfrom

cstroie:speculative

Commits on Apr 16, 2026

feat: add --mem parameter to load model into RAM instead of mmap

cstroie
and
aider-chat-bot
committed
fix: fix model_load call and signed comparison warning

cstroie
and
aider-chat-bot
committed
feat: add --mem option for model loading mode selection

cstroie
and
aider-chat-bot
committed
feat: add fast mode with optimized parameters for better performance

cstroie
and
aider-chat-bot
committed
feat: enhance performance with SSE2 optimizations and update build configurations
cstroie
committed
feat: add AVX support for optimized vector operations and enhance performance
cstroie
committed
docs: update README for AVX support, build targets, and --mem option

cstroie
and
claude
committed
feat: enhance SIMD support with AVX2 optimizations and update build configurations
cstroie
committed

Commits on May 7, 2026