Skip to content

Commit 3174f60

Browse files
committed
Add _is_stateful property to OVBaseDecoderModel
1 parent 2590794 commit 3174f60

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

optimum/intel/openvino/modeling_decoder.py

+4
Original file line numberDiff line numberDiff line change
@@ -193,6 +193,10 @@ def raise_error(model_prop, user_prop, name):
193193
if not self._compile_only and enable_compilation:
194194
self.compile()
195195

196+
@property
197+
def _is_stateful(self) -> bool:
198+
return self.stateful
199+
196200
def update_pkv_precision(self, force_fp32=False):
197201
if not self.use_cache or self.stateful or self._compile_only:
198202
return

0 commit comments

Comments
 (0)