Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pipe nvtx markers from Tripy to TRT engine #176

Open
parthchadha opened this issue Sep 4, 2024 · 1 comment
Open

Pipe nvtx markers from Tripy to TRT engine #176

parthchadha opened this issue Sep 4, 2024 · 1 comment
Assignees
Milestone

Comments

@parthchadha
Copy link
Collaborator

Goal: get kernel information for each frontend layer for easier performance debugging and directed unit tests (ex: MHA layer maps to a single fused kernel).

Tripy already passes loc attribute to stablehlo program that gets generated. We need to pipe the attribute information to TRT layer metadata and correlate the kernel information to the frontend APIs.

@pranavm-nvidia
Copy link
Collaborator

#191

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants