Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

requirementsR.txt referencing HEAD leads to irreproducibility / pipeline breaking #538

Open
jaicher opened this issue May 3, 2024 · 3 comments

Comments

@jaicher
Copy link

jaicher commented May 3, 2024

drop/requirementsR.txt specifies installation of OUTRIDER, FRASER, and tMAE to install from the HEAD of their respective git repositories.

This leads to two problems:

  1. The pipeline is not necessarily reproducible if there are changes made to any of those repositories.
  2. The pipeline can unexpectedly break with respect to those changes.

The second problem happened to me this week. FRASER was updated last week to have strand-specific counting per sample (rather than globally set over analyses): gagneurlab/FRASER#72. However, the scripts in the DROP repository have not been updated. This causes an error in aberrant-splicing-pipeline/Counting/01_1_countRNA_splitReads_samplewise.R, line 38; the conditional has length > 1, which throws an exception.

While DROP itself needs to be updated to reflect FRASER's new behavior, I think DROP should also specify fixed commits for installation to ensure that changes to the HEAD of the git repositories on which it is dependent do not break DROP or affect its reproducibility between DROP versions.

@jaicher
Copy link
Author

jaicher commented May 4, 2024

It looks like #537 will hopefully address the immediate issue I ran into with the updated version of FRASER.

I would still hope for some kind of predictable versioning of DROP's dependencies. If one were to publish an analysis using DROP, how should they report the version of OUTRIDER/FRASER/tMAE that they used? How could someone else wanting to reproduce their analysis set up a matching environment that didn't integrate changes made to these dependencies?

@vyepez88
Copy link
Collaborator

vyepez88 commented May 6, 2024

Hi Joseph, indeed, we are aware of all those issues and are working on addressing them. We'll come back to you in the next few days.

@vyepez88
Copy link
Collaborator

Hi Joseph. Thanks again for raising these concerns. With v 1.3.4 we have tried to be more robust to different versions of packages and dependencies. We now install only specific versions. We recommend you install 1.4.0, which further contains improvements to FRASER.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants