Feature - slurm_arrayjob.sh + run_experiment.sh #1
Description
Template for arrayjob and a script to run an experiment. The run_experiment script will automatically adjust the ArrayTaskThrottle to account for how many people are on the box and how many people there are in the sprio queue. The idea is you'll set a min and max number of jobs to run in parallel, and if there are lots of people waiting, the number of jobs will be decreased, but to increase utilisation, it will increase if there are lots of free gpus.
scontrol update ArrayTaskThrottle=36 JobId=450263