The Simple Chatbot for testing and deploying LLM models

Test and deploy the latest LLM models in the fastest and most efficient way

Prerequisites

• Ollama should be installed and running
• Pull a model to use with the library: ollama pull <model> e.g. ollama pull deepseek-r1:1.5b
  • See Ollama.com for more information on the models available.

Install

conda create -n chatbot python=3.12 # create env
conda activate chatbot 
pip install poetry # install poetry
poetry install # install dependencies

Run Chabot

python app.py # run app

* Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.

Full Video:

Watch the full video here