You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
运行的代码如下:
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("/home/slm/ZLYproject/Multimodal_LLM/visualglm-6b", trust_remote_code=True)
model = AutoModel.from_pretrained("/home/slm/ZLYproject/Multimodal_LLM/visualglm-6b", trust_remote_code=True).half().cuda()
image_path = "/home/slm/ZLYproject/Multimodal_LLM/1.jpg"
response, history = model.chat(tokenizer, image_path, "描述这张图片。", history=[])
print(response)
response, history = model.chat(tokenizer, image_path, "这张图片可能是在什么场所拍摄的?", history=history)
print(response)
出现错误:ImportError: cannot import name 'DeepSpeedTransformerInference' from partially initialized module 'deepspeed.model_implementations.transformers.ds_transformer' (most likely due to a circular import)
请问这是为什么!!太崩溃了!!!求助!!!
具体报错如下:
Traceback (most recent call last):
File "/home/slm/ZLYproject/Multimodal_LLM/try.py", line 3, in
model = AutoModel.from_pretrained("/home/slm/ZLYproject/Multimodal_LLM/visualglm-6b", trust_remote_code=True).half().cuda()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 558, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/transformers/modeling_utils.py", line 2954, in from_pretrained
model = cls(config, *model_args, **model_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/slm/.cache/huggingface/modules/transformers_modules/visualglm-6b/modeling_chatglm.py", line 1344, in init
from .visual import BLIP2
File "/home/slm/.cache/huggingface/modules/transformers_modules/visualglm-6b/visual.py", line 4, in
from sat.model import ViTModel, BaseModel
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/sat/init.py", line 6, in
from .training.deepspeed_training import training_main
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/sat/training/deepspeed_training.py", line 27, in
import deepspeed
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/deepspeed/init.py", line 25, in
from . import ops
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/deepspeed/ops/init.py", line 11, in
from . import transformer
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/deepspeed/ops/transformer/init.py", line 8, in
from ...model_implementations.transformers.ds_transformer import DeepSpeedTransformerInference
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/deepspeed/model_implementations/transformers/ds_transformer.py", line 18, in
from deepspeed.ops.transformer.inference.triton.mlp import TritonMLP
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/deepspeed/ops/transformer/inference/init.py", line 7, in
from ....model_implementations.transformers.ds_transformer import DeepSpeedTransformerInference
ImportError: cannot import name 'DeepSpeedTransformerInference' from partially initialized module 'deepspeed.model_implementations.transformers.ds_transformer' (most likely due to a circular import) (/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/deepspeed/model_implementations/transformers/ds_transformer.py)
The text was updated successfully, but these errors were encountered:
运行的代码如下:
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("/home/slm/ZLYproject/Multimodal_LLM/visualglm-6b", trust_remote_code=True)
model = AutoModel.from_pretrained("/home/slm/ZLYproject/Multimodal_LLM/visualglm-6b", trust_remote_code=True).half().cuda()
image_path = "/home/slm/ZLYproject/Multimodal_LLM/1.jpg"
response, history = model.chat(tokenizer, image_path, "描述这张图片。", history=[])
print(response)
response, history = model.chat(tokenizer, image_path, "这张图片可能是在什么场所拍摄的?", history=history)
print(response)
出现错误:ImportError: cannot import name 'DeepSpeedTransformerInference' from partially initialized module 'deepspeed.model_implementations.transformers.ds_transformer' (most likely due to a circular import)
请问这是为什么!!太崩溃了!!!求助!!!
具体报错如下:
Traceback (most recent call last):
File "/home/slm/ZLYproject/Multimodal_LLM/try.py", line 3, in
model = AutoModel.from_pretrained("/home/slm/ZLYproject/Multimodal_LLM/visualglm-6b", trust_remote_code=True).half().cuda()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 558, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/transformers/modeling_utils.py", line 2954, in from_pretrained
model = cls(config, *model_args, **model_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/slm/.cache/huggingface/modules/transformers_modules/visualglm-6b/modeling_chatglm.py", line 1344, in init
from .visual import BLIP2
File "/home/slm/.cache/huggingface/modules/transformers_modules/visualglm-6b/visual.py", line 4, in
from sat.model import ViTModel, BaseModel
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/sat/init.py", line 6, in
from .training.deepspeed_training import training_main
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/sat/training/deepspeed_training.py", line 27, in
import deepspeed
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/deepspeed/init.py", line 25, in
from . import ops
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/deepspeed/ops/init.py", line 11, in
from . import transformer
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/deepspeed/ops/transformer/init.py", line 8, in
from ...model_implementations.transformers.ds_transformer import DeepSpeedTransformerInference
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/deepspeed/model_implementations/transformers/ds_transformer.py", line 18, in
from deepspeed.ops.transformer.inference.triton.mlp import TritonMLP
File "/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/deepspeed/ops/transformer/inference/init.py", line 7, in
from ....model_implementations.transformers.ds_transformer import DeepSpeedTransformerInference
ImportError: cannot import name 'DeepSpeedTransformerInference' from partially initialized module 'deepspeed.model_implementations.transformers.ds_transformer' (most likely due to a circular import) (/home/slm/miniconda3/envs/PY311/lib/python3.11/site-packages/deepspeed/model_implementations/transformers/ds_transformer.py)
The text was updated successfully, but these errors were encountered: