ik_llama.cpp backend for localAI? · mudler LocalAI · Discussion #8507 · GitHub

slu-010101
Feb 11, 2026

Hi,

is it possible to add the ik_llama.cpp [1] backend to localAI?
We have much better performance on CPU only LLM.

Thanks.

Sam

[1] https://github.com/ikawrakow/ik_llama.cpp

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment