Pipeline Parallelism with DeepSpeed #11806
Unanswered
amorehead
asked this question in
DDP / multi-GPU / multi-node
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello. I was wondering if Lightning currently supports a "pipeline parallel" way to use its DeepSpeed integration. If not, is there a timeline on when such a feature may be added to the library? Thanks in advance for your time and clarification, from whomever that may be.
Beta Was this translation helpful? Give feedback.
All reactions