Skip to content

Check for transfer conditional on resolved symlink path

Robert Rosca requested to merge fix/migration-check-repo-only-offline into master

Description

Closes #59

Implemented the changes as we discussed in the standup today. The location of the run directory is resolved, then the response from MyMdC is checked to see if the transfer has been complete or not.

So, even if the GPFS transfer is done, if the resolved path is on PNFS then it will continue waiting.

Overall:

  1. Added cycle and instrument arguments to wait_on_transfer and wait_transfers
  2. Use those vars with config['correct']['in-folder'].format(...) to get the proposal dir
  3. Resolve the path to proposal_dir / f"{run:06d}"
  4. If that path is relative to /gpfs/exfel/d then then check that GPFS transfer is done, else if it is rel. to /pnfs check that DCACHE transfer is done
  5. Update calls to wait_transfers to pass through the cycle and proposal

How Has This Been Tested?

TBC

Relevant Documents (optional)

Types of changes

  • Bug fix (non-breaking change which fixes an issue)

Checklist:

  • My code follows the code style of this project.

Reviewers

@calibration

Merge request reports