-
Notifications
You must be signed in to change notification settings - Fork 1.3k
[Feature] LLm timeout #87
Copy link
Copy link
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Summary
Add a setting to env for LLM timeout
Why This Matters
Not all cases demand for quick LLM response. I like to run on ollama on mid range hardware and responses can trigger the timeout. I've now editted ollama.mjs to extend the timeout since I don't mind waiting for the LLM generated content to populate.
A setting would be more convenient and may help others as well.
Proposed Behavior
Have a setting in de env file that controls the LLM timeout.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request