[DataFile] Add parallel dataset compression

Description

For a while now, we are using the parallelized compression offered by write_compressed_frames. This MR adds this capability to the DataFrame API to write such compressed datasets side-by-side with uncompressed ones.

How Has This Been Tested?

Running LPD_Correct_Fast with default arguments.

Types of changes

• Refactor (refactoring code with no functionality changes)

Reviewers

@ahmedk

notebooks/Jungfrau/Jungfrau_Gain_Correct_and_Verify_NBC.ipynb

@@ -99,7 +99,6 @@
     "    get_dir_creation_date,\n",
     "    get_pdu_from_db,\n",
     "    map_seq_files,\n",
-    "    write_compressed_frames,\n",
     "    CalibrationMetadata,\n",
     ")\n",
     "from iCalibrationDB import Conditions, Constants\n",
@@ -590,11 +589,10 @@
     "            outp_source.create_key(\n",
     "                \"data.adc\", data=data_corr,\n",
     "                chunks=(min(chunks_data, data_corr.shape[0]), *oshape[1:]))\n",
-    "\n",
-    "            write_compressed_frames(\n",
-    "                gain_corr, outp_file, f\"{outp_source.name}/data/gain\", comp_threads=8)\n",
-    "            write_compressed_frames(\n",
-    "                mask_corr, outp_file, f\"{outp_source.name}/data/mask\", comp_threads=8)\n",
+    "            outp_source.create_compressed_key(\n",
+    "                \"data.gain\", data=gain_corr)\n",
+    "            outp_source.create_compressed_key(\n",
+    "                \"data.mask\", data=mask_corr)\n",
     "\n",
     "            save_reduced_rois(outp_file, data_corr, mask_corr, local_karabo_da)\n",
     "\n",