Pegasus doesn't work with the new version of stashcp (or pelican)

[spxiwh]

TLDR: OSDF transfers are not going to work on LDG clusters (still fine on OSG for now) unless we get a new pegasus release, or one uses an older version of stashcp (e.g. through singularity images).

We have a potential problem with OSDF transfers that may hit us soon. If transferring a frame file using stashcp, one might do (with the current version) something like this:

/usr/bin/stashcp 'osdf:///igwn/ligo/frames/O4/hoft_C00_AR/H1/H-H1_HOFT_C00_AR-137/H-H1_HOFT_C00_AR-1379799472-3664.gwf' '/var/lib/condor/execute/dir_756338/pegasus.A9vIaXze4/137979/H-H1_HOFT_C00_AR-1379799472-3664.gwf'

However, with current releases of pegasus, it will do the following:

/usr/bin/stashcp  '/igwn/ligo/frames/O4/hoft_C00/H1/H-H1_HOFT_C00-136/H-H1_HOFT_C00-1369489408-4096.gwf' ./H-H1_HOFT_C00-1369489408-4096.gwf

which fails with:

ERROR[2025-01-22T07:56:01-08:00] Failure transferring /igwn/ligo/frames/O4/hoft_C00_AR/H1/H-H1_HOFT_C00_AR-137/H-H1_HOFT_C00_AR-1379799472-3664.gwf: unable to determine direction of transfer.  Both source and destination are either local or remote 

using:

/usr/bin/stashcp --version
Version: 7.12.0

This is a new thing, using an older stashcp (e.g. in the singularity image):

singularity shell /cvmfs/singularity.opensciencegrid.org/pycbc/pycbc-el8:v2.3.8
Apptainer> stashcp --version
Version: 7.10.5

the same commang works

Apptainer> /usr/bin/stashcp  '/igwn/ligo/frames/O4/hoft_C00/H1/H-H1_HOFT_C00-136/H-H1_HOFT_C00-1369489408-4096.gwf' ./H-H1_HOFT_C00-1369489408-4096.gwf

There is already a patch to fix this (and support the new client, pelican, by default). This hasn't yet made a release.

[spxiwh]

As an addendum to this ... I think we also shouldn't declare that OSDF files are on site=local. Pegasus then seems to think that there is a file URL it can use, which causes additional failures. Can't test this though until we have a new pegasus release because the patch from Mats changes a bit about how OSDF files are handled