You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Fix: Verify scales are not None for Cutlass FP8 FusedMoE (#1961)
## 📌 Description
Verify quant scales for fp8 are non null in cutlass FusedMoE path.
Currently, if these tensors are passed as None from python it will
result in segmentation fault.
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit
* **Bug Fixes**
* Enhanced validation for FP8 quantization parameters to improve system
robustness and prevent potential null reference issues during
quantization operations, reducing the risk of runtime errors when
processing quantized model data.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->
---------
Signed-off-by: Amir Klein <[email protected]>
0 commit comments