You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
We currently maintain prompt templates per model class but that is not scalable. Most models contain a prompt template in the tokenizer_config.json that we could parse and use instead.
Describe the solution you'd like
Create a Jinja parser to parse the templates in the tokenizer_config.json to use as a template for gen ai models
Is your feature request related to a problem? Please describe.
We currently maintain prompt templates per model class but that is not scalable. Most models contain a prompt template in the tokenizer_config.json that we could parse and use instead.
Describe the solution you'd like
Create a Jinja parser to parse the templates in the tokenizer_config.json to use as a template for gen ai models
Additional context
https://huggingface.co/docs/transformers/en/chat_templating
The text was updated successfully, but these errors were encountered: