Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

temp and root partition swapped #42

Open
michabp opened this issue Mar 11, 2024 · 4 comments
Open

temp and root partition swapped #42

michabp opened this issue Mar 11, 2024 · 4 comments

Comments

@michabp
Copy link

michabp commented Mar 11, 2024

For two weeks or so the root partition and the temp partition has been swapped on around 20% of the runners.

Which results in temp getting bigger and root staying small:

/dev/root                     73G   73G  100M 100% /
@easimon
Copy link
Owner

easimon commented Mar 11, 2024

Please see #39 (comment)

Can this be an explanation for what you see?

The tmpfs you mentioned is not the temp partition, but a ramdisk, mounted to /tmp. The temp disk should be mounted at /mnt.

@michabp
Copy link
Author

michabp commented Mar 12, 2024

Thank you!

Yes, that's probably it. However, I'm confused on what the fix is. Whatever I specify in temp-reserve-mb will end up getting added to /dev/root.
But if try to make temp-reserve-mb very large (4096) it'll throw fallocate: invalid length value specified.

@easimon
Copy link
Owner

easimon commented Mar 12, 2024

What are you trying to achieve? The action combines all free space on / and /mnt into an lvm volume, which is then mounted as the workspace directory. The workspace is the place where most build jobs require the most space.

The reserve parameters are to control how much space is not consumed by the lvm volume, so you can still add files outside the workspace... E.g. to download docker images, install further packages via apt-get etc.

By increasing the reserve, you decrease the amount available in the workspace folder.

The temp reserve is something you should seldomly need to adjust, since by default nothing (I know of) writes to /mnt.

@ljmf00-wekaio
Copy link

I'm getting this too: fallocate: invalid length value specified.

What I think @michabp is suggesting is: check if /mnt mountpoint really exists and do the calculations accordingly, otherwise its inconsistent for both configurations.
If we reserve space on /mnt and / but /mnt doesn't really exist, the reserve total space should be merged, so that it doesn't underflow/overflow on our situation, which is exactly what is happening right now.

It used to be 20% of the runners but now its almost all runners, from my experience.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants