Skip to content

Commit 0c2a884

Browse files
committed
Add _is_stateful property to OVBaseDecoderModel
1 parent 95f1345 commit 0c2a884

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

optimum/intel/openvino/modeling_decoder.py

+4
Original file line numberDiff line numberDiff line change
@@ -197,6 +197,10 @@ def raise_error(model_prop, user_prop, name):
197197
if not self._compile_only and enable_compilation:
198198
self.compile()
199199

200+
@property
201+
def _is_stateful(self) -> bool:
202+
return self.stateful
203+
200204
def update_pkv_precision(self, force_fp32=False):
201205
if not self.use_cache or self.stateful or self._compile_only:
202206
return

0 commit comments

Comments
 (0)