Examples

Welcome to dstack-examples. This repository contains a collection of examples demonstrating how to use dstack.

1. Setup

Install the open-source dstack server and configure cloud credentials or opt for the cloud version.

1.1. Install dstack

pip install "dstack[all]" -U

1.2 Configure clouds

Configure cloud credentials in ~/.dstack/server/config.yml. Learn more.

1.3. Start the server

dstack server

2. Run examples

2.1. Init the repo

git clone https://github.com/dstackai/dstack-examples
cd dstack-examples
dstack init

2.2. Run a dev environment

Here's how to run a dev environment with the current repo:

dstack run . --gpu 24GB

2.3. Run any example

Here's how to run any of the examples, e.g. vllm:

dstack run . -f deployment/vllm/serve.dstack.yml --gpu 24GB

Find more details on each example at dstack.ai/examples.

More information

• Docs