about the batch_size and training speed

[NeilHnxTcc]

when I increased the batch size from 2 to 4, the training time for a step increased from 15s to 30s, why? Given that the GPU-Util is already 100% when the bs=2 and I only use one GPU to train the model, I can't figure out the reason of this phenomenon.

[Shaosifan]

when I increased the batch size from 2 to 4, the training time for a step increased from 15s to 30s, why? Given that the GPU-Util is already 100% when the bs=2 and I only use one GPU to train the model, I can't figure out the reason of this phenomenon.

Hi, I also tried to use one GPU to train the model, but I met this issue . Do you know what cause this issue. Many thanks!

[NeilHnxTcc]

I think that is because the GPU has already reached its computation performance ceiling....