Skip to content

Commit

Permalink
Formatting.
Browse files Browse the repository at this point in the history
  • Loading branch information
GeorgiosSmyrnis committed Dec 11, 2023
1 parent 2dcf57b commit 51f889b
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion open_lm/main.py
Original file line number Diff line number Diff line change
Expand Up @@ -243,7 +243,9 @@ def main(args):
# fully initialize distributed device environment
device = init_distributed_device(args)

assert args.global_batch_size % args.world_size == 0, "Global batch size is not divisible by number of GPUs, and thus cannot be respected."
assert (
args.global_batch_size % args.world_size == 0
), "Global batch size is not divisible by number of GPUs, and thus cannot be respected."

args.per_gpu_batch_size = args.global_batch_size // args.world_size

Expand Down

0 comments on commit 51f889b

Please sign in to comment.