Skip to content

FIX: dot product issue causing high RAM usage in reconst_fw_noddi#366

Merged
arnaudbore merged 2 commits into
nf-neuro:mainfrom
gagnonanthony:feat/add_options_to_noddi_fw
May 25, 2026
Merged

FIX: dot product issue causing high RAM usage in reconst_fw_noddi#366
arnaudbore merged 2 commits into
nf-neuro:mainfrom
gagnonanthony:feat/add_options_to_noddi_fw

Conversation

@gagnonanthony
Copy link
Copy Markdown
Member

@gagnonanthony gagnonanthony commented May 22, 2026

Bug category

  • Critical (some functionalities is not working at all)
  • Major (something is not working as expected)
  • Minor (something but could be improved)
  • Trivial (documentation needs correcting and other non-functional issues)

Describe the bug

Previous implementation used the .combine operator to mix the priors together. However, when supplying per-subject priors for a lot of subjects, this causes nextflow to create an exponential number of tuples, which bloats up the RAM usage (I made it up to 64GB, which does not make any sense). This PR fixes this while retaining all functionalities.

Tested on 300 subjects and 526 subjects, everything runs smoothly!

Steps to reproduce the bug

Run the noddi subworkflow across many subjects while supplying per-subject priors.

@gagnonanthony gagnonanthony self-assigned this May 22, 2026
@gagnonanthony gagnonanthony requested a review from a team May 22, 2026 01:57
@gagnonanthony gagnonanthony changed the title FIX: dot product issue causing high RAM usage in reconstruction_fw_noddi FIX: dot product issue causing high RAM usage in reconst_fw_noddi May 22, 2026
@gagnonanthony
Copy link
Copy Markdown
Member Author

When you are ready @AlexVCaron and @arnaudbore, it should be good to review!

Copy link
Copy Markdown
Contributor

@arnaudbore arnaudbore left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

GTG

@arnaudbore arnaudbore added this pull request to the merge queue May 25, 2026
Merged via the queue into nf-neuro:main with commit 83f36bd May 25, 2026
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants