Skip to content

[Performance] Enhance the software loop pipelining for tt.load with tensor of pointer #3485

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
chengjunlu opened this issue Feb 21, 2025 · 1 comment · Fixed by #4051 · May be fixed by #3634
Closed

[Performance] Enhance the software loop pipelining for tt.load with tensor of pointer #3485

chengjunlu opened this issue Feb 21, 2025 · 1 comment · Fixed by #4051 · May be fixed by #3634
Assignees
@whitneywhtsang @etiotto @chengjunlu
Labels
performance
Milestone
4. [Performance] ...

Comments

@chengjunlu
Copy link
Contributor

Enhance the software loop pipelining for tt.load with tensor of pointer
@vlad-penkin vlad-penkin added this to the 4.0 [Performance] Core milestone Feb 24, 2025
@chengjunlu chengjunlu linked a pull request Mar 10, 2025 that will close this issue
[Performance] Add the support of tensor of pointer in the prefetching and loop pipelining #3634
Draft
@chengjunlu chengjunlu self-assigned this Mar 10, 2025
@etiotto etiotto linked a pull request Apr 29, 2025 that will close this issue
[MatmulLoopPipeline]: Prefetch 2D loads #4051
Merged
@etiotto
Copy link
Contributor

etiotto commented May 5, 2025

Performance of GEMM using tensor of ptrs improves by almost 100%:

Image

@etiotto etiotto closed this as completed May 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@whitneywhtsang whitneywhtsang

@etiotto etiotto

@chengjunlu chengjunlu

Labels
performance
Projects
None yet
Milestone
4. [Performance] Core
4 participants
@whitneywhtsang @etiotto @chengjunlu @vlad-penkin