[BUG]: Generic OpenAI endpoint does not work with Ollama

[sharpe5]

How are you running AnythingLLM?

AnythingLLM desktop app on MacOS (Macbook Pro).

What happened?

I want to connect AnythingLLM to Ollama using the generic OpenAI-compatible endpoint. I configure as per the API docs on Ollama:

However, when I create a new workspace, chats are broken.

Yes, it is possible to configure AnythingLLM to talk directly to Ollama, but this is also broken and I would prefer to use a generic OpenAI-compatible endpoint.

Are there known steps to reproduce?

To reproduce:

1. Install ollama locally from www.ollama.com.
2. Run Ollama locally:

gravitas@PHIENGINE1 C:\Users\Gravitas>ollama run llama3.2
>>> test
It looks like you're just testing to see if I'm working.

3. Attempt to configure AnythingLLM to talk to Ollama via the OpenAI-compatible endpoint.

[timothycarambat]

Yeah, because it works differently than ollama does for stream chunk handling. Just use the Ollama provider since it is fully supported as an LLM anyways - then you wont have any issues!