How to run NNI on TPU

[Harshit Singhal (H-arshit)]

I want to run my trials on TPU. What changes do i have to make in config.yml.

[QuanluZhang]

Hi Harshit Singhal (@H-arshit) , I have not used TPU, but I assume it is provided within a VM. Then it would be pretty easy to run NNI on TPU through NNI's remote machine mode. In your scenario, let's say you have 3 TPU-VMs (T1, T2, T3), and another VM T0. Note that T1/T2/T3 and T0 should be reachable to each other. Then you can create an nni experiment on T0, and the yaml config file of this experiment should include the configure (e.g., username, password) of the 3 TPU-VMs. Here is a detailed document of how to setup remote machine mode.

[Yuge Zhang (ultmaster)]

Harshit Singhal (@H-arshit) Any updates?

[Scarlett Li (scarlett2018)]

Hi Harshit Singhal (@H-arshit) , I have not used TPU, but I assume it is provided within a VM. Then it would be pretty easy to run NNI on TPU through NNI's remote machine mode. In your scenario, let's say you have 3 TPU-VMs (T1, T2, T3), and another VM T0. Note that T1/T2/T3 and T0 should be reachable to each other. Then you can create an nni experiment on T0, and the yaml config file of this experiment should include the configure (e.g., username, password) of the 3 TPU-VMs. Here is a detailed document of how to setup remote machine mode.

Harshit Singhal (@H-arshit) any feedback? thanks.