[Gotthard2][CORRECT] calcat interface

Start using calcat interface with Gotthard2 correction.

Related to https://git.xfel.eu/calibration/planning/-/issues/150

Description

notebooks/Gotthard2/Gotthard2_retrieve_constants_precorrection_NBC.ipynb:

• Retrieve all constants in one go and validate the availability for the constants and raise Error/Warning accordingly.
• Updating the YAML metadata keys based on the attributes in the CalibrationData metadata object.

notebooks/Gotthard2/Correction_Gotthard2_NBC.ipynb:

• Using calcat interface to retrieve constants if YAML is not available.

How Has This Been Tested?

Tested against reference runs

Relevant Documents (optional)

Types of changes

• New feature (non-breaking change which adds functionality)

Checklist:

Reviewers

@schmidtp @kluyvert

added New CALCAT interface Testing labels

changed the description

assigned to @ahmedk

added 61 commits

• 9dd6ed7a...1c5290cc - 22 commits from branch master
• 19033cb0 - Draft: new calcat interface and corresponding updates in the correction notebook
• 50fb68ec - Expose calcat_interface in the docs
• e926128f - change calibration.py to calcat_interface.py and refactors
• 5ed9ecf1 - retest epix100 and add warning
• 7dbe4400 - calcat_interface_lpd_epix_jf
• 3faf72c3 - epix100 changes
• c62d83ea - Update agipd correction
• e735ea2f - update calcat_interface after testing notebooks
• 88acf12c - update pnccd
• d14acc38 - use snapshot for epix100
• 32dde25f - update lpd notebook
• 1defc617 - update gotthard2
• 3b08ec1b - update jungfrau
• d01191d0 - fix tests/test_cal_tools
• f7e98305 - add restful_config to notebooks
• 437faea2 - add da_to argument and apply black
• b1ef743a - add missing client input args
• 14018b95 - update da_to to module_naming
• c3648eaf - epix fixes
• 97911561 - remove agipd changes
• 161d4cd6 - remove jungfrau changes
• e7631e0a - remove pnccd changes
• b1cabe04 - remove epix100 changes
• 58845f6f - remove Gotthard2 changes
• 070d574f - remove LPD changes
• 2ac3e42e - remove cal_tools.tools changes
• c55c4575 - remove development pieces
• 1f67f1cb - snapshot_at to pdu_snapshot_at, restful_config.calibration_client(), and move...
• a2280278 - add module naming back in CalCatApi
• 5fff3ca6 - add test
• a337f9b6 - add more tests
• 3d5b449e - fix ndarray and fix format_time time format to calcat expected isoformat
• 30494205 - remove pdu_snapshot_at from CalibrationData
• 64d1ee56 - update calibration client version
• b5fd3784 - fix DSSC_CalibrationData
• 1a53b90e - consider illuminated conditions for pnCCD
• e93a8de7 - remove noise from conflict resoving
• d957dc6f - gotthard2 calcat interface
• dfb99cd7 - use rest_cfg and fix some bugs

Compare with previous version

marked this merge request as draft from 19033cb0

marked this merge request as ready

removed Testing label

changed target branch from master to feat/new_calcat_interface

changed target branch from feat/new_calcat_interface to master

added 53 commits

• dfb99cd7...af6e09b5 - 50 commits from branch master
• b004e9d3 - gotthard2 calcat interface
• ed34334b - use rest_cfg and fix some bugs
• 7e3c4fbd - remove unused libraries and convert RelativeGain

Compare with previous version

added 10 commits

• 7e3c4fbd...43af30c3 - 6 commits from branch master
• f12c3ab9 - gotthard2 calcat interface
• a55ca1f5 - use rest_cfg and fix some bugs
• 53a88133 - remove unused libraries and convert RelativeGain
• 7b2cd4cd - fix validation and error only for lut and fix constant keys

Compare with previous version

changed the description

LGTM other than those minor points.

added 1 commit

• d8bbce0d - Error out if dark constants are missing for all modules

Compare with previous version

added 1 commit

• 3d8f17ff - Error out if dark constants are missing for all modules

Compare with previous version

resolved all threads

changed milestone to %3.9.0