any plans on implementing this possibility into dify core and tools as by other tools I can see a significant profit from using these as money saving

It is a bit of a complicated feature to implement, because cache is not set in model config options - but per prompt.

So we need a way through the UI to specify that a certain prompt should be cached - similar to how you can enable jinja templates with a slider.

I have made a working version that just uses specific tags to trigger caching, but I don't think Dify would be interested in this solution, as it's a poor UX solution

It is a bit of a complicated feature to implement, because cache is not set in model config options - but per prompt.

So we need a way through the UI to specify that a certain prompt should be cached - similar to how you can enable jinja templates with a slider.

I have made a working version that just uses specific tags to trigger caching, but I don't think Dify would be interested in this solution, as it's a poor UX solution

I believe conversational checkbox next to send button is way to go for now.
But most importantly it also has to be implemented as configurable variable in workflow and agents, it can serve as quick job done, avoiding or even preparing good RAG

Hi, @amatiytsiv. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary

• Request to add prompt caching support for Anthropic Claude in model configuration.
• Complexity arises as caching is set per prompt, not in model config options.
• Discussion on implementing a UI solution, similar to enabling jinja templates.
• You suggested a conversational checkbox next to the send button for configuration.

Next Steps

• Is this issue still relevant to the latest version of the Dify repository? If so, please comment to keep the discussion open.
• Otherwise, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!