forked from redpanda-data/redpanda
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
storage: add compaction index memory semaphore to storage_resources
This is an additional bound, on top of the existing _max_mem in spill_key_index: it will now also avoid using more memory in total per shard. This commit uses a static total of 128MB, which enables up to 256 compacted partitions to use the same 512kiB per-partition allowance that they were using before, then as the partition count gets higher it starts throttling back, although each partition always gets to use at least 32kib memory each, to avoid a pathological case where they spill on every key add.
- Loading branch information
Showing
2 changed files
with
26 additions
and
4 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters