A3C doesn't complete. #4
Description
When I tried with run_a3c_on_cartpole.sh, I can get training outputs in worker_0/1.stdout. However, the multiprocesses simply never finish in a clean way and there is always one or two python processes hanging there and waiting to be killed by hand.