Add Node to update KV cache in Stateful LLM model #872

Merged

Kotomi-Du merged 15 commits intointel:ovep-developfrom

Kotomi-Du:update_kvcache_node

Jan 7, 2026

Commits on Dec 17, 2025

Reorder KV cache using the new gather_by_axis API

mdvoretc-intel
authored and
ZackyLake
committed
Do a ScatterElementsUpdate-based reorder during execution

mdvoretc-intel
authored and
ZackyLake
committed
Get variable update lengths from incoming indices

mdvoretc-intel
authored and
ZackyLake
committed
Make changes to support new KVCache fusion

mdvoretc-intel
authored and
ZackyLake
committed
Add proper include

mdvoretc-intel
authored and
ZackyLake
committed
add reorder KV cache API

Kotomi-Du
authored and
ZackyLake
committed
clean up code

Kotomi-Du
authored and
ZackyLake
committed
add post process for internal handled inputs

Kotomi-Du
authored and
ZackyLake
committed
disable update_kvcache for npu + pass kv info

Kotomi-Du
authored and
ZackyLake
committed
refactor code

Kotomi-Du
authored and
ZackyLake
committed
minor change

Kotomi-Du
authored and
ZackyLake
committed
refactor with int32 indices, string_view parsing.
ZackyLake
committed

Commits on Dec 30, 2025

fix naming
ZackyLake
committed

Commits on Jan 6, 2026