Skip to content

How to get dtypes? #1577

@sroussey

Description

@sroussey

Question

How do i get a list of dtypes (quants) available for a model?

Image

I'm trying to make my project easier to actually use before i get a job somewhere, so I am adding a way to search for models via @huggingface/hub. I would like to add a way for someone to choose from available quants. Do I just traverse the files and look for patterns to tell me? Maybe model registry could do this?

Also, i search for onnx on the hub, but is that sufficient to be sure the model will work with transformers.js?

Ref: huggingface/huggingface.js#2037

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions