Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

can this only be used with together.ai and not locally? #33

Open
nunbuzor opened this issue Sep 20, 2024 · 3 comments
Open

can this only be used with together.ai and not locally? #33

nunbuzor opened this issue Sep 20, 2024 · 3 comments

Comments

@nunbuzor
Copy link

No description provided.

@BishalN
Copy link

BishalN commented Nov 12, 2024

you can use this app locally if you run llm locally in your machine;
and you can run llms locally using ollama;
https://ollama.com/

@akshaynmhc
Copy link

akshaynmhc commented Nov 26, 2024

this can run any api, just change base URL and API KEY, also change model respectively in dropdown.

@beuself
Copy link

beuself commented Dec 11, 2024

you can use this app locally if you run llm locally in your machine; and you can run llms locally using ollama; https://ollama.com/

I found that the code invokes the together-api package, and it seems that the API is not compatible with Ollama's API.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants