Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speedup FRASER couting on Cluster #266

Open
wants to merge 2 commits into
base: dev
Choose a base branch
from
Open

Speedup FRASER couting on Cluster #266

wants to merge 2 commits into from

Conversation

mumichae
Copy link
Collaborator

Copy BAM files to local resources.tmpdir for faster processing. This would probably require Snakemake>=6.0

@mumichae mumichae changed the base branch from master to dev October 20, 2021 07:55
Copy link
Contributor

@c-mertes c-mertes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey, two points:

  1. is the temp folder run specific? Otherwise we could remove the file if concurrent processes are accessing the files. E.g. multiple datasets will run it multiple times.

  2. this is really infrastructure dependent and could degrade others performance. Did you do benchmarks on the efficiency?

@mumichae
Copy link
Collaborator Author

Sorry for the late reply.

  1. The tmp folder is ID specific, so I would assume it is run specific, as Snakemake shouldn't be running two IDs twice.
  2. I did not benchmark the efficiency, it's just something I used to speed up the aberrant splicing module. Even if with lower file latency, I don't think it would hurt, but if you find this modification unneccessary, I can also close this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants