[LPD][CORRECT] Using CALCAT interface

Start using calcat interface with LPD

Related to https://git.xfel.eu/calibration/planning/-/issues/150

Description

notebooks/LPD/LPD_retrieve_constants_precorrection.ipynb:

• Retrieve all constants in one go and validate the availability for the constants and raise Error/Warning accordingly.
• Updating the YAML metadata keys based on the attributes in the CalibrationData metadata object.

notebooks/LPD/LPD_Correct_Fast.ipynb:

• Using calcat interface to retrieve constants if YAML is not available.

How Has This Been Tested?

Tested against reference runs. The validation against reference runs failed. Because this MR has a fix of getting the correct constant based on the correct PDU mapping. Unlike before, which was using the latest mapping. with no snapshots.

Relevant Documents (optional)

Types of changes

• New feature (non-breaking change which adds functionality)

Checklist:

Reviewers

@kluyvert @schmidtp

added New CALCAT interface Testing labels

assigned to @ahmedk

changed the description

added 1 commit

• 7d4bad39 - restful config client

Compare with previous version

added 1 commit

• 882c0715 - remove snapshot_at

Compare with previous version

added 1 commit

• fb9b0151 - specify constants to retrieve

Compare with previous version

added 61 commits

• fb9b0151...1c5290cc - 19 commits from branch master
• 19033cb0 - Draft: new calcat interface and corresponding updates in the correction notebook
• 50fb68ec - Expose calcat_interface in the docs
• e926128f - change calibration.py to calcat_interface.py and refactors
• 5ed9ecf1 - retest epix100 and add warning
• 7dbe4400 - calcat_interface_lpd_epix_jf
• 3faf72c3 - epix100 changes
• c62d83ea - Update agipd correction
• e735ea2f - update calcat_interface after testing notebooks
• 88acf12c - update pnccd
• d14acc38 - use snapshot for epix100
• 32dde25f - update lpd notebook
• 1defc617 - update gotthard2
• 3b08ec1b - update jungfrau
• d01191d0 - fix tests/test_cal_tools
• f7e98305 - add restful_config to notebooks
• 437faea2 - add da_to argument and apply black
• b1ef743a - add missing client input args
• 14018b95 - update da_to to module_naming
• c3648eaf - epix fixes
• 97911561 - remove agipd changes
• 161d4cd6 - remove jungfrau changes
• e7631e0a - remove pnccd changes
• b1cabe04 - remove epix100 changes
• 58845f6f - remove Gotthard2 changes
• 070d574f - remove LPD changes
• 2ac3e42e - remove cal_tools.tools changes
• c55c4575 - remove development pieces
• 1f67f1cb - snapshot_at to pdu_snapshot_at, restful_config.calibration_client(), and move...
• a2280278 - add module naming back in CalCatApi
• 5fff3ca6 - add test
• a337f9b6 - add more tests
• 3d5b449e - fix ndarray and fix format_time time format to calcat expected isoformat
• 30494205 - remove pdu_snapshot_at from CalibrationData
• 64d1ee56 - update calibration client version
• b5fd3784 - fix DSSC_CalibrationData
• 1a53b90e - consider illuminated conditions for pnCCD
• e93a8de7 - remove noise from conflict resoving
• ab37f1cd - move import into the function
• 9bd3b7ed - LPD calcat interface
• c2d6f5a7 - restful config client
• e8fd0d59 - remove snapshot_at
• 99cd58f5 - specify constants to retrieve

Compare with previous version

marked this merge request as draft from 19033cb0

marked this merge request as ready

changed target branch from master to feat/new_calcat_interface

removed Testing label

added 1 commit

• bb98085e - 1 commit from branch feat/new_calcat_interface

Compare with previous version

added 31 commits

• bb98085e...334e93c0 - 31 commits from branch feat/new_calcat_interface

Compare with previous version

added 1 commit

• 01c9b152 - 1 commit from branch feat/new_calcat_interface

Compare with previous version

changed target branch from feat/new_calcat_interface to master

added 1 commit

• 5cb3d617 - remove unused libraries

Compare with previous version

added 1 commit

• d5df8992 - warn instead of error for missing darks for some modules

Compare with previous version

added 38 commits

• d5df8992...43af30c3 - 29 commits from branch master
• fdb14377 - LPD calcat interface
• a1c4cfc1 - restful config client
• 90977f9c - remove snapshot_at
• 1e51d6ee - specify constants to retrieve
• 5b78540d - fix correction
• 8ffdf128 - rebase and resolve mem_cell_order changes
• eb1e795d - remove unused libraries
• 6d385144 - warn instead of error for missing darks for some modules
• b35b1c1c - improve constant validation and add ccv_id

Compare with previous version

changed the description