You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, I'm now trying to deploy the model. But it turns out that the inference time is about 230ms. (On TRX2060). Comparing to the result that you mentioned on the paper, it's not normal. So I want to know what should I be careful about the deployment.
What's more, I find that the preprocess takes also a long time. (About 120ms). How can I improve it?
Thanks in advance.
The text was updated successfully, but these errors were encountered:
Hi, I'm now trying to deploy the model. But it turns out that the inference time is about 230ms. (On TRX2060). Comparing to the result that you mentioned on the paper, it's not normal. So I want to know what should I be careful about the deployment.
What's more, I find that the preprocess takes also a long time. (About 120ms). How can I improve it?
Thanks in advance.
The text was updated successfully, but these errors were encountered: