Adding kv-cache invalidation when generation hits short factor threshold#4117

AlexanderKalistratov wants to merge 7 commits into

openvinotoolkit:masteropenvinotoolkit/openvino.genai:masterfrom

AlexanderKalistratov:longrope_sdpa_kvcache_invalidationAlexanderKalistratov/openvino.genai:longrope_sdpa_kvcache_invalidationCopy head branch name to clipboard