Skip to content

Commit 8ad64e2

Browse files
authored
Bugfix: Change get() -> GetDLTensorPtr() in cutlass FusedMoE validations (#1995)
## 📌 Description Using different API after `apach-tvm-ffi` version bump. <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit * **Bug Fixes** * Improved null-pointer validation for FP8 quantization tensors used during inference, increasing robustness and reducing risk of runtime errors. <!-- end of auto-generated comment: release notes by coderabbit.ai --> --------- Signed-off-by: Amir Klein <[email protected]>
1 parent 135d7bc commit 8ad64e2

File tree

1 file changed

+6
-5
lines changed

1 file changed

+6
-5
lines changed

csrc/fused_moe/cutlass_backend/flashinfer_cutlass_fused_moe_sm100_binding.cu

Lines changed: 6 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -822,11 +822,12 @@ class FusedMoeRunner : public tvm::ffi::ModuleObj {
822822
auto const fc2_dequant = quant_scales.value()[2];
823823
auto const fc1_input_dequant = quant_scales.value()[3];
824824

825-
TVM_FFI_ICHECK(fc1_dequant.get() != nullptr) << "Expecting fc1_dequant to be non null";
826-
TVM_FFI_ICHECK(fc2_quant.get() != nullptr) << "Expecting fc2_quant to be non null";
827-
TVM_FFI_ICHECK(fc2_dequant.get() != nullptr)
828-
<< "Expecting fc2_dequant_dequant to be non null";
829-
TVM_FFI_ICHECK(fc1_input_dequant.get() != nullptr)
825+
TVM_FFI_ICHECK(fc1_dequant.GetDLTensorPtr() != nullptr)
826+
<< "Expecting fc1_dequant to be non null";
827+
TVM_FFI_ICHECK(fc2_quant.GetDLTensorPtr() != nullptr) << "Expecting fc2_quant to be non null";
828+
TVM_FFI_ICHECK(fc2_dequant.GetDLTensorPtr() != nullptr)
829+
<< "Expecting fc2_dequant to be non null";
830+
TVM_FFI_ICHECK(fc1_input_dequant.GetDLTensorPtr() != nullptr)
830831
<< "Expecting fc1_input_dequant to be non null";
831832

832833
// Check types

0 commit comments

Comments
 (0)