More rate of GPU utilization instead of one gpu for one trial

[rickyyyxu]

Hello, in nni, I can set trialGpuNumber: 1 to let one trial use a gpu. If I have two gpu, just two trial can concurrently run.
So, how can one gpu support many trials in the same experiment when gpu space is enough?

Thank you~

[QuanluZhang]

@coasxu , you can use maxTrialNumberPerGpu, more detailed here: https://nni.readthedocs.io/en/stable/reference/experiment_config.html#maxtrialnumberpergpu

[rickyyyxu]

Wow, it's really helpful, I will get a try!