[DataFile] Add parallel dataset compression
Description
For a while now, we are using the parallelized compression offered by write_compressed_frames. This MR adds this capability to the DataFrame API to write such compressed datasets side-by-side with uncompressed ones.
How Has This Been Tested?
Running LPD_Correct_Fast with default arguments.
Types of changes
- Refactor (refactoring code with no functionality changes)