Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to set keep_alive parameter #401

Open
harshachopra507 opened this issue Dec 31, 2024 · 0 comments
Open

Unable to set keep_alive parameter #401

harshachopra507 opened this issue Dec 31, 2024 · 0 comments

Comments

@harshachopra507
Copy link

Hi,
I am using ollama.AsyncClient() for parallel processing of documents. I am setting keep_alive parameter from ollama.AsyncClient().chat(keep_alive=-1).

I have also tried setting env variable, os.environ["OLLAMA_KEEP_ALIVE"] = "-1"

While checking ollama ps from the terminal, I see connective alive UNTIL 5 minutes (which is default). While running python script, after 5 minutes the code is getting stuck because ollama models running using ollama python client is getting stopped.

How can I resolve this issue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant