Skip to content

Adding kv-cache invalidation when generation hits short factor threshold#4117

Open
AlexanderKalistratov wants to merge 7 commits into
openvinotoolkit:masterfrom
AlexanderKalistratov:longrope_sdpa_kvcache_invalidation
Open

Adding kv-cache invalidation when generation hits short factor threshold#4117
AlexanderKalistratov wants to merge 7 commits into
openvinotoolkit:masterfrom
AlexanderKalistratov:longrope_sdpa_kvcache_invalidation

Adjust max_kv_cache_size, remove debug output and adress review comments

75d33b6
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
triage
succeeded Jul 10, 2026 in 4s