Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

set precision to fp32 #131

Open
cicoita opened this issue Jan 8, 2024 · 2 comments
Open

set precision to fp32 #131

cicoita opened this issue Jan 8, 2024 · 2 comments

Comments

@cicoita
Copy link

cicoita commented Jan 8, 2024

Hi,

I'm using segnet to load a custom segmentation network and I was wondering if I can change precision to fp32?

Currently I am getting this when i run it
...
[TRT] desired precision specified for GPU: FASTEST
...
[TRT] selecting fastest native precision for GPU: FP16

Thanks for the help :)

@cicoita
Copy link
Author

cicoita commented Jan 8, 2024

Oh and I am getting this error I haven't noticed before

[TRT] Registering tensor: output_34 for ONNX tensor: output
[TRT] Resize_261 [Resize] outputs: [output -> (1, 12, 1080, 1920)[FLOAT]],
[TRT] Marking output_34 as output: output
[TRT] Marking onnx::Resize_335_2 as output: onnx::Resize_335
[TRT] Marking input.1_3 as output: input.1
[TRT] Marking input.3_4 as output: input.3
[TRT] Marking output as output: output
�[0;31m[TRT] [network.cpp::markOutputHelper::1811] Error Code 4: Internal Error (Tensor output is already set as network output)

Do you know how this can be fixed?

@dusty-nv
Copy link
Owner

dusty-nv commented Jan 8, 2024

@cicoita the segmentation models in ros_deep_learning / jetson-inference are expected to be FCN-Resnet from PyTorch architecture. You might have better luck with the newer Isaac ROS Image Segmentation package: https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_image_segmentation

And I don't believe I expose the desired precision as a ROS param, but you could hardcode that change or expose it if desired.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants