Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Add genai config prompt template parser #142

Open
nmetulev opened this issue Jan 31, 2025 · 0 comments
Open

[FEATURE] Add genai config prompt template parser #142

nmetulev opened this issue Jan 31, 2025 · 0 comments

Comments

@nmetulev
Copy link
Member

Is your feature request related to a problem? Please describe.
We currently maintain prompt templates per model class but that is not scalable. Most models contain a prompt template in the tokenizer_config.json that we could parse and use instead.

Describe the solution you'd like
Create a Jinja parser to parse the templates in the tokenizer_config.json to use as a template for gen ai models

Additional context
https://huggingface.co/docs/transformers/en/chat_templating

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant