Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

mimir: support for ingest-storage.ingestion-partition-tenant-shard-size #7804

Merged
merged 4 commits into from
Apr 4, 2024

Conversation

narqo
Copy link
Contributor

@narqo narqo commented Apr 4, 2024

What this PR does

This one updates the mimir operations, adding the support for the -ingest-storage.ingestion-partition-tenant-shard-size config, used with the "ingest storage" mode.

As discussed privately with @pracucci, we would like to have a way to gradually apply the new configuration across internal Mimir deployments. Thus, the jsonnet only applies the flag if the mimir._config.shuffle_sharding.ingest_storage_partitions_enabled is raised.

Also updated the calculated overrides, adding the support for ingestion_partitions_tenant_shard_size there.

Checklist

  • Tests updated.
  • Documentation added.
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX].
  • about-versioning.md updated with experimental features.

Signed-off-by: Vladimir Varankin <vladimir.varankin@grafana.com>
@narqo narqo requested a review from a team as a code owner April 4, 2024 12:49
Copy link
Collaborator

@pracucci pracucci left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very good job, LGTM!

operations/mimir/shuffle-sharding.libsonnet Outdated Show resolved Hide resolved
operations/mimir/shuffle-sharding.libsonnet Outdated Show resolved Hide resolved
operations/mimir/shuffle-sharding.libsonnet Outdated Show resolved Hide resolved
narqo and others added 2 commits April 4, 2024 18:05
Co-authored-by: Marco Pracucci <marco@pracucci.com>
Signed-off-by: Vladimir Varankin <vladimir.varankin@grafana.com>
Copy link
Collaborator

@pracucci pracucci left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

Signed-off-by: Vladimir Varankin <vladimir.varankin@grafana.com>
@pracucci pracucci merged commit 38b9c85 into main Apr 4, 2024
29 checks passed
@pracucci pracucci deleted the mimir-mixin-ingestion-partitions-shars-size branch April 4, 2024 18:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants