Skip to content

[AGIPD][CORRECT] maxtaskperchild multiprocessing pool configuration

Karim Ahmed requested to merge feat/maxtaskperchild into master

Add maxtasksperchild configuration to reduce number of tasks per worker and avoid possible memory leaks

Description

While debugging the Out of memory issue while correcting very long AGIPD runs. @kluyvert pointed to an option to specify the number of tasks a worker can handle before it gets replaced with a new worker.

How Has This Been Tested?

Relevant Documents (optional)

Types of changes

  • New feature (non-breaking change which adds functionality)

Checklist:

Reviewers

@schmidtp @kluyvert

Edited by Karim Ahmed

Merge request reports