File tree Expand file tree Collapse file tree 1 file changed +3
-2
lines changed
content/operate/rc/langcache Expand file tree Collapse file tree 1 file changed +3
-2
lines changed Original file line number Diff line number Diff line change @@ -39,7 +39,8 @@ LangCache reduces your LLM costs by caching responses and avoiding repeated API
39
39
For every cached response, you'll save the output token cost. To calculate your monthly savings with LangCache, you can use the following formula:
40
40
41
41
``` bash
42
- Estimated monthly savings with LangCache = (Monthly output token costs) × (Cache hit rate)
42
+ Est. monthly savings with LangCache =
43
+ (Monthly output token costs) × (Cache hit rate)
43
44
```
44
45
45
46
The more requests you serve from LangCache, the more you save, because you’re not paying to regenerate the output.
@@ -52,7 +53,7 @@ Here’s an example:
52
53
- Estimated savings: $120 × 50% = $60/month
53
54
54
55
{{<note >}}
55
- The forumla and numbers above will provide a rough estimate of your monthly savings. Actual savings will vary depending on your usage.
56
+ The formula and numbers above provide a rough estimate of your monthly savings. Actual savings will vary depending on your usage.
56
57
{{</note >}}
57
58
58
59
## LangCache architecture
You can’t perform that action at this time.
0 commit comments