Enable HPSS via Globus

[DavidHuber-NOAA]

Description

This enables the archiving or ROTDIR tarballs to HPSS from systems that are not connected directly to HPSS as long as they can communicate to Niagara via Globus.

Transfers are initialized by the Sven client on Hercules or Orion and then finished on Niagara using the Doorman service. Documentation on these services can be found here: Sven User's Guide. These services were developed by George Fekete.

Resolves #1357

Type of change

• New feature (adds functionality)

Change characteristics

• Is this a breaking change (a change in existing functionality)? NO
• Does this change require a documentation update? YES
• Does this change require an update to any of the following submodules? NO

How has this been tested?

• Cycle test on Hercules
• Forecast-only test on Hercules
• Cycle test on Orion

Checklist

• Any dependent changes have been merged and published
• My code follows the style guidelines of this project
• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas
• I have documented my code, including function, input, and output descriptions
• My changes generate no new warnings
• New and existing tests pass with my changes
• This change is covered by an existing CI test or a new one has been added
• Any new scripts have been added to the .github/CODEOWNERS file with owners
• I have made corresponding changes to the system documentation if necessary

[DavidHuber-NOAA]

FYI @erinjones2 @CatherineThomas-NOAA @AndrewEichmann-NOAA

[DavidHuber-NOAA]

I have finished a forecast-only test on Hercules. Additional work is required to enable this feature for ensembles, but it is mature enough for reviews. Thus marking this PR ready for review.

[KateFriedman-NOAA]

A lot of changes to review, just a few questions to start.

[DavidHuber-NOAA]

Let's go ahead and move forward with this PR. I will add ensemble support in another PR.

[CoryMartin-NOAA]

Did not test, no complaints from me. Thanks for adding this and addressing the minor comments I made earlier!

[DavidHuber-NOAA]

This PR is ready to be reviewed again for technical aspects; documentation updates are still forthcoming.

Globus/HPSS testing completed successfully on Hercules for a C48_S2SW case.

I made one significant feature change that affects archiving options. The options HPSSARCH and LOCALARCH have been replaced with DO_ARCHTAR and ARCHTAR_TO. The first is either YES or NO and the second can be hpss, local, or globus_hpss.

[CoryMartin-NOAA]

will there be a need to archive the early-cycle enkf? if so, should this be JGLOBAL?

[DavidHuber-NOAA]

Yes, the early-cycle is archivable as well. I will go ahead and make that change, but note that the ensembles are not currently being archived via globus -- that will be in a follow-up PR.