-
Notifications
You must be signed in to change notification settings - Fork 45
Open
Description
Describe the bug
UnboundLocalError: local variable 'mlp_layernorm_out' referenced before assignment when trying to run Falcon
To Reproduce
common_cfg = ed.EasyDeLBaseConfigDict(
max_position_embeddings=2048,
use_scan_mlp=False,
)
model = ed.AutoEasyDeLModelForCausalLM.from_pretrained(
pretrained_model_name_or_path="tiiuae/falcon-7b",
dtype=dtype,
param_dtype=dtype,
config_kwargs=common_cfg,
trust_remote_code=True,
)
Metadata
Metadata
Assignees
Labels
No labels