WandB Logger in Single Machine + Multi-GPU DDP setting

[angadkalra]

I'm switching from MLFlowLogger to WandbLogger, and one problem I've run into is that when using > 1 GPUs, the logging for the WandBLogger breaks after the first GPU instance gets initialized. Reading the WandB documentation, it looks like the WandB Run object is not available on any rank > 0. So have these commands from the PL docs been tested in multi-gpu setting?

# add one parameter
wandb_logger.experiment.config["key"] = value

# add multiple parameters
wandb_logger.experiment.config.update({key1: val1, key2: val2})

# use directly wandb module
wandb.config["key"] = value
wandb.config.update()

Because I keep getting these errors before Trainer.fit(...) is called:

This is happening using PyTorch-Lightning 2.0.0, PyTorch 1.13.1, on 2 V100 GPUs.

[angadkalra]

@carmocca Can you help with this please?