Skip to content
Snippets Groups Projects

[GH2][Correct] Gain constant needs to be float32

Merged Karim Ahmed requested to merge fix/GH2_correct_wrong_gain_dtype into master
1 unresolved thread

This fixes the reported issue at https://redmine.xfel.eu/issues/147905

Description

Corrections were failing because the Cython correction function expected float32 constants. As the gain constant was injected as float64, I made sure that the gain constant is converted to the right type before being used for correction.

Marco was also notified and he will make sure that notebook is injecting gain constant of the expected type.

How Has This Been Tested?

Tested locally and hotfixed in production

Relevant Documents (optional)

Types of changes

  • Bug fix (non-breaking change which fixes an issue)

Checklist:

Reviewers

@kluyvert @hammerd

Merge request reports

Loading
Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
326 326 " mask[index, ...],\n",
327 327 " g,\n",
328 328 " const_data[mod][\"Offset\"],\n",
329 " const_data[mod][\"RelativeGain\"],\n",
329 " const_data[mod][\"RelativeGain\"].astype(np.float32),\n",
  • Other than that, LGTM.

  • Karim Ahmed resolved all threads

    resolved all threads

  • Karim Ahmed added 1 commit

    added 1 commit

    Compare with previous version

  • Thank you!

  • Karim Ahmed enabled an automatic merge when the pipeline for bd593655 succeeds

    enabled an automatic merge when the pipeline for bd593655 succeeds

  • merged

  • Karim Ahmed mentioned in commit 43af30c3

    mentioned in commit 43af30c3

  • Please register or sign in to reply
    Loading