After enabling "Cache miss notices" in pi's settings, I'm seeing quite a few cache misses like: `Cache miss: 67k tokens re-billed (~$0.10)` on fast-follow messages (<1 minute) that should not cause a prefix cache miss.
After enabling "Cache miss notices" in pi's settings, I'm seeing quite a few cache misses like:
Cache miss: 67k tokens re-billed (~$0.10)on fast-follow messages (<1 minute) that should not cause a prefix cache miss.