Skip to content

关于生僻字问题 #22

@bubblelcc

Description

@bubblelcc

您好,我尝试了一下您的项目,发现有生僻字没在vocab.txt里面时,会报Keyerror,而尝试使用add_tokens发现没有这个方法,有什么办法可以解决吗

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions