[AGIPD][TESTs]test_agipdlib AGIPDCtrl and get_bias_voltage for AGIPD1M and AGIPD500K

Based on https://git.xfel.eu/detectors/pycalibration/-/merge_requests/651

• Test AGIPDCtrl() methods to read conditions from Fast or slow data.
• differentiate between AGIPD1M and AGIPD500K sources and keys to read bias_voltage. (temporary unbreakable change.)

Description

Latest changes to agipdlib had a class AGIPDCtrl() created collecting all methods to read AGIPD parameter conditions from fast and slow data.

1. I have added tests for these methods
2. I have split some methods based on their functionality.
3. As bias_voltage is stored in different paths for AGIPD1M and AGIPD500K, a condition was added to select the right source.

• This is a temporary change and I think one should give the correct source and key through get_bias_voltage arguments.

4. All of the tests are based on EXtra-data mocked data. I have added mock_agipd1m_run, mock_agipd500K_run and mock_agipd1m_run_old at :

How Has This Been Tested?

Unit tests.

Relevant Documents (optional)

Types of changes

• Test (additional or refactored tests)

Checklist:

• My code follows the code style of this project.
• I have updated the documentation accordingly.
• I added tests where appropriate.

Reviewers

@calibration

webservice/webservice.py

@@ -238,14 +238,16 @@ def change_config(config, updated_config, instrument,
     return yaml.safe_dump(new_conf, default_flow_style=False).encode()
 
 
-async def run_proc_async(cmd: List[str]) -> Tuple[int, bytes]:
+async def run_proc_async(cmd: List[str]) -> Tuple[Optional[int], bytes, bytes]:
     """Run a subprocess to completion using asyncio, capturing stdout
 
     Returns the numeric exit code and stdout (bytes)
     """
-    proc = await asyncio.create_subprocess_exec(*cmd, stdout=asyncio.subprocess.PIPE)
-    stdout, _ = await proc.communicate()
-    return proc.returncode, stdout
+    proc = await asyncio.create_subprocess_exec(
+        *cmd, stdout=asyncio.subprocess.PIPE, stderr=asyncio.subprocess.PIPE
+    )
+    stdout, stderr = await proc.communicate()
+    return proc.returncode, stdout, stderr
 
 
 def slurm_status(filter_user=True):
@@ -479,9 +481,10 @@ async def run_action(job_db, cmd, mode, proposal, run, rid) -> str:
     """
     if mode == "prod":
         logging.info(" ".join(cmd))
-        retcode, stdout = await run_proc_async(cmd)
+        retcode, stdout, stderr = await run_proc_async(cmd)
         if retcode != 0:
             logging.error(Errors.JOB_LAUNCH_FAILED.format(cmd, retcode))
+            logging.error(f"{stdout=}, {stderr=}")
             return Errors.JOB_LAUNCH_FAILED.format(cmd, retcode)
 
         if "DARK" in cmd:
@@ -741,12 +744,13 @@ async def get_slurm_nice(partition: str, instrument: str,
         return 0  # Don't apply degressive priority on exfel.
 
     # List all names for jobs running in the specified partition.
-    returncode, job_names = await run_proc_async(
+    returncode, job_names, stderr = await run_proc_async(
         ['squeue', '-h', '-o', '%.20j', '-p', partition, '--me'])
 
     if returncode != 0:
         logging.error(f'Non-zero return code {returncode} from '
                       f'`squeue` upon counting number of jobs')
+        logging.warning(f"{stderr=}")
         return 0  # Fallback if something went wrong.
 
     # Base value depending on proposal type using cycle, assuming that