Deploy llama-stack, llama-serve, and safety-model

Create namespace/project

Choose a desired namespace/project name and create it using the following command:

oc new-project <NAMESPACE>

For more details and options, see https://cookbook.openshift.org/projects-and-user-collaboration/how-do-i-create-a-new-project-from-the-command-line.html.

Create huggingface token secret

Obtain your huggingface token and create it in the same namespace/project:

oc create secret -n <NAMESPACE>> generic huggingface-secret --from-literal=HF_TOKEN="<YOUR HF TOKEN>" --dry-run=client -o yaml | oc apply -f -

Choose a desired release name and annotate the created secret accordingly with it:

oc annotate secret huggingface-secret -n <NAMESPACE> meta.helm.sh/release-name=<RELEASE NAME> meta.helm.sh/release-namespace=<NAMESPACE> --overwrite

Install Helm chart

With the directory containing this README.md as the current working directory, run the following command to install the chart:

helm upgrade --install <RELEASE NAME> ./llamastack-minimal -n <NAMESPACE>