Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add validation for cloud storage cache size to be a multiple of segment size #5896

Closed
abhijat opened this issue Aug 8, 2022 · 1 comment
Closed
Labels
area/cloud-storage Shadow indexing subsystem kind/enhance New feature or request

Comments

@abhijat
Copy link
Contributor

abhijat commented Aug 8, 2022

Who is this for and what problem do they have today?

when tiered storage/SI is used in redpanda, the cloud storage cache needs to be set up to be some size so that it can hold multiple segments. We should validate that the size is at least 10x the segment size.

What are the success criteria?

The application startup validates that the cloud storage cache is at least 10x the segment size.

Why is solving this problem impactful?

The cloud storage cache undergoes segment eviction if it is full. With a cache smaller than a single segment, it is possible for each read to cause an eviction negatively affecting performance.

Additional notes

The current documentation suggests a minimum cloud storage cache size of 20 GB.

@jcsp
Copy link
Contributor

jcsp commented Feb 21, 2023

I think we'll end up doing https://github.com/redpanda-data/core-internal/issues/374 to avoid the need for the cache to be this large before we get around to this ticket.

@jcsp jcsp closed this as completed Feb 21, 2023
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/cloud-storage Shadow indexing subsystem kind/enhance New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants