You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It should be possible to mix-and-match arrays on Grace Hopper systems, e.g. CPU kernels can access arrays residing in GPU memory and vice versa. A runtime check requiring all arrays to be allocated on the same device as the kernel is one of the things preventing this from working:
f"Error launching kernel '{kernel.key}', trying to launch on device='{device}', but input array for argument '{arg_name}' is on device={value.device}."
)
There might be additional changes required for this capability to be performant.
Similarly, it should be possible to mix-and-match GPU arrays when peer access is enabled on peer-capable GPUs.
Context
Take advantage of platform features.
The text was updated successfully, but these errors were encountered:
Description
It should be possible to mix-and-match arrays on Grace Hopper systems, e.g. CPU kernels can access arrays residing in GPU memory and vice versa. A runtime check requiring all arrays to be allocated on the same device as the kernel is one of the things preventing this from working:
warp/warp/context.py
Lines 4945 to 4949 in 211b962
There might be additional changes required for this capability to be performant.
Similarly, it should be possible to mix-and-match GPU arrays when peer access is enabled on peer-capable GPUs.
Context
Take advantage of platform features.
The text was updated successfully, but these errors were encountered: