Seeing a lot of these the last few days:
DataflowJobAlreadyExistsError(\\napache_beam.runners.dataflow.internal.apiclient.DataflowJobAlreadyExistsError: There is already active job named gh-pforgetest-gpcp-from-gcs-feedstock-ce8e56a-1700347024 with id: 2023-11-18_14_37_13-15130123773093506439. If you want to submit a second job, try again by setting a different name using --job_name.", "status": "failed"}\n', stderr=b'(unset)\n').returncode
(link here)
This is always fixed by re-running the failed job, which suggests that the timestamp is just non-unique in the job name because we are deploying too many jobs at too close an interval to each other. Might be resolved by #139 (or might be a separate but related issue).
Seeing a lot of these the last few days:
(link here)
This is always fixed by re-running the failed job, which suggests that the timestamp is just non-unique in the job name because we are deploying too many jobs at too close an interval to each other. Might be resolved by #139 (or might be a separate but related issue).