Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

include reasoning tokens in ui #802

Open
tarasglek opened this issue Jan 26, 2025 · 3 comments
Open

include reasoning tokens in ui #802

tarasglek opened this issue Jan 26, 2025 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@tarasglek
Copy link
Owner

tarasglek commented Jan 26, 2025

deepseek returns https://api-docs.deepseek.com/guides/reasoning_model reasoning tokens. We should use html details/summary feature for this

openrouter is gonna support this for all reasoning models

this is gonna be interesting for also explicitly including reasoning context when switching models to do function calls, etc that reasoning models suck at

@mulla028
Copy link
Collaborator

Could you elaborate on this one, I would like to learn the entire idea 💡

@tarasglek
Copy link
Owner Author

tarasglek commented Jan 26, 2025

We can render messages using https://developer.mozilla.org/en-US/docs/Web/HTML/Element/details

<details>
|reasoning_content from r1 model(we dont parse these out atm)|
<summary>
content from r1(same as what we see now)
</summary>
</details

Eg

|reasoning_content from r1 model(we dont parse these out atm)| content from r1(same as what we see now)

@mulla028 mulla028 added the enhancement New feature or request label Jan 28, 2025
@mulla028
Copy link
Collaborator

@tarasglek sounds interesting, may I try?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants