Skip to content

[New Model]: 0.17.0RC1 GLM5 known issues #7471

@ZYang6263

Description

@ZYang6263

The model to consider.

GLM-5 is already supported in vLLM-Ascend 0.17.0.rc1. You can refer to the GLM-5 deployment guide
for instructions on how to deploy GLM-5 with vLLM-Ascend. The model is available on ModelScope: ZhipuAI/GLM-5. This issue documents the existing problems.

Current Known Issues

  1. Address out of range error in the graph mode. This issue 7401 is described in detail.
  2. GLM5 requires transformers 5.2.0. Since GLM-5 does not yet have a corresponding model implementation in vLLM, a newer version of transformers is required. Related issue: 35395.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions