-
Notifications
You must be signed in to change notification settings - Fork 62
[MatmulLoopPipeline] Predicate PrefetchOp
#4016
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Signed-off-by: Whitney Tsang <[email protected]>
@@ -154,7 +155,7 @@ static Value getPredMask(RewriterBase &rewriter, Type typeLike, | |||
Value currentMask, Value pred) { | |||
Location loc = pred.getLoc(); | |||
Value mask = pred; | |||
Type maskType = tt::getI1SameShape(typeLike); | |||
Type maskType = tt::getI1SameShape(tt::getPointeeType(typeLike)); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The type of mask should be getI1SameShape(getPointeeType($_self))
as defined in https://github.com/intel/intel-xpu-backend-for-triton/blob/main/include/triton/Dialect/Triton/IR/TritonOps.td#L233.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What does typeLike means ? Lets document the parameters this function take and also what it does.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
added function description.
3fd9a80
to
6c7a802
Compare
@@ -154,7 +155,7 @@ static Value getPredMask(RewriterBase &rewriter, Type typeLike, | |||
Value currentMask, Value pred) { | |||
Location loc = pred.getLoc(); | |||
Value mask = pred; | |||
Type maskType = tt::getI1SameShape(typeLike); | |||
Type maskType = tt::getI1SameShape(tt::getPointeeType(typeLike)); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What does typeLike means ? Lets document the parameters this function take and also what it does.
third_party/intel/lib/TritonIntelGPUTransforms/Pipeliner/MatmulLoopPipeline.cpp
Outdated
Show resolved
Hide resolved
Signed-off-by: Whitney Tsang <[email protected]>
Signed-off-by: Whitney Tsang <[email protected]>
88fe8be
to
a4b2e2a
Compare
Signed-off-by: Whitney Tsang <[email protected]>
a4b2e2a
to
cc4150d
Compare
Signed-off-by: Whitney Tsang <[email protected]>
Now that
PrefetchOp
takesmask
as an argument, we can handle predication ofPrefetchOp
inMatmulLoopPipeline
.Benchmark CI: https://github.com/intel/intel-xpu-backend-for-triton/actions/runs/14657236822 (No performance regressions.)
Note: this change comes partially from #3634.