Node Request: Teapot LLM

[iwr-redmond]

Teapot LLM is a new 800M model designed for hallucination-resistant information extraction. It has been released with its own Python package, teapotai.

This would be an excellent addition to NodeTool. It even has a Pydantic-based data extraction function.

[georgi]

Models compatible with transformers AutoPipeline are already supported, anything else requires custom code. Teapot has only 90 downloads in the last month, so not sure if we should prioritize it. There may be better options now?

[iwr-redmond]

It's an undiscovered gem, but YMMV

[georgi]

Checked the source, the model itself can be auto-loaded with transformers but there is a classifier and some RAG code around it: https://github.com/zakerytclarke/teapot/blob/main/src/teapotai/teapotai.py

I think it may make sense to support the whole Teapot pipeline as a workflow, with multiple nodes, one for the TextGeneration, one classifier, RAG etc