Skip to content

Falcon is broken (MLP error) #242

@jasshone

Description

@jasshone

Describe the bug
UnboundLocalError: local variable 'mlp_layernorm_out' referenced before assignment when trying to run Falcon

To Reproduce
common_cfg = ed.EasyDeLBaseConfigDict(
max_position_embeddings=2048,
use_scan_mlp=False,
)
model = ed.AutoEasyDeLModelForCausalLM.from_pretrained(
pretrained_model_name_or_path="tiiuae/falcon-7b",
dtype=dtype,
param_dtype=dtype,
config_kwargs=common_cfg,
trust_remote_code=True,
)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions