Combining DDP with Model Parallelism #17448
Unanswered
ssnnoo
asked this question in
DDP / multi-GPU / multi-node
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
From the documentation it is not clear to me how to combine ddp with model parallel as described here : https://pytorch.org/tutorials/intermediate/ddp_tutorial.html#combining-ddp-with-model-parallelism
Mia there any example? How are the devices assigned? Thank you very much!
Beta Was this translation helpful? Give feedback.
All reactions