-
Notifications
You must be signed in to change notification settings - Fork 12
Reducing squeue polling per guidelines #15
Copy link
Copy link
Open
Description
It looks like this polls squeue every second:
Lines 157 to 165 in 978afa5
| while True: | |
| latest_jobs = self._get_jobs() | |
| with self.lock: | |
| self.latest_jobs = latest_jobs | |
| if not self.requests.empty(): | |
| cmd = self.requests.get(block=False) | |
| self._run_command(cmd) | |
| sleep(1) |
However, ComputeCanada guidelines say:
Do not run
sqorsqueuefrom a script or program at high frequency, e.g., every few seconds. Responding tosqueueadds load to Slurm, and may interfere with its performance or correct operation. See Email notification below for a much better way to learn when your job starts or ends.
It might be good to add a way to reduce polling to every hour or disable it altogether.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels