Skip to content

模型名字写错了 #43

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Demired wants to merge 1 commit into
base: main
Choose a base branch
from
Open

模型名字写错了 #43

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 6 additions & 6 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -312,7 +312,7 @@ image: https://hub.docker.com/r/hunyuaninfer/hunyuan-7B/tags

We provide a pre-built Docker image based on the latest version of TensorRT-LLM.

We use tencent/Hunyuan-7B-MT for example
We use tencent/Hunyuan-MT-7B for example
- To get started:

```
Expand Down Expand Up @@ -368,19 +368,19 @@ First, please install transformers. We will merge it into the main branch later.
pip install git+https://github.com/huggingface/transformers@4970b23cedaf745f963779b4eae68da281e8c6ca
```

We use tencent/Hunyuan-7B-MT for example
We use tencent/Hunyuan-MT-7B for example
- Download Model file:
- Huggingface: will download automicly by vllm.
- ModelScope: `modelscope download --model Tencent-Hunyuan/Hunyuan-7B-MT`
- ModelScope: `modelscope download --model Tencent-Hunyuan/Hunyuan-MT-7B`

- model download by huggingface:
```shell
export MODEL_PATH=tencent/Hunyuan-7B-MT
export MODEL_PATH=tencent/Hunyuan-MT-7B
```

- model downloaded by modelscope:
```shell
export MODEL_PATH=/root/.cache/modelscope/hub/models/Tencent-Hunyuan/Hunyuan-7B-MT/
export MODEL_PATH=/root/.cache/modelscope/hub/models/Tencent-Hunyuan/Hunyuan-MT-7B/
```

- Start the API server:
Expand Down Expand Up @@ -488,7 +488,7 @@ python3 -m vllm.entrypoints.openai.api_server \

We also provide a pre-built Docker image based on the latest version of SGLang.

We use tencent/Hunyuan-7B-MT for example
We use tencent/Hunyuan-MT-7B for example

To get started:

Expand Down