RuntimeError: radix_sort: failed on 1st step: cudaErrorInvalidDevice: invalid device ordinal

[cchen156]

Loading from checkpoint: /neurmips/checkpoints/replica-kitchen-experts.pth
Baked planes alpha as [200 * 200]
Traceback (most recent call last):
  File "experts_test_fast.py", line 220, in main
    mnh_cuda.sort_by_key_float32_int64(active_depth, reorder_indices_by_depth)
RuntimeError: radix_sort: failed on 1st step: cudaErrorInvalidDevice: invalid device ordinal

Hi @zhihao-lin , Great work! Any ideas for this error? Downloaded the pretrained model and run fast eval.

[haoyuhsu]

Thanks for your interest in our work!

I wonder if you could provide the environment and the GPU you are currently running the program with?
For example,

• PyTorch (1.7.1)
• cudatoolkit (10.2)
• CUDA (i.e. nvcc) (10.2)
• GPU (Titan RTX) or you are running on multiple GPUs server?

It would be easier for us to debug if you provide the information above. Thanks~~