Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BaseGatewayShardAllocator changes for Assigning the batch of shards #8776

Merged
merged 9 commits into from
Mar 15, 2024

Conversation

Gaurav614
Copy link
Contributor

@Gaurav614 Gaurav614 commented Jul 19, 2023

Description

This pull request is part of overall improvement #5098
And mainly is around assignment of batches of shards.

The PR is indirectly dependent on following PRs for overall closure of functionality:
#8742
#8218
#8356
#8746
PSA+RSA changes [yet to be raised]

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed per the DCO using --signoff
  • Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Gaurav Chandani <chngau@amazon.com>
@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

Copy link
Contributor

@amkhar amkhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @Gaurav614 for making this change. Suggested few changes, please apply those to whole PR code.

Signed-off-by: Gaurav Chandani <chngau@amazon.com>
@github-actions
Copy link
Contributor

github-actions bot commented Sep 6, 2023

Compatibility status:

Checks if related components are compatible with change ddd088f

Incompatible components

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/flow-framework.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/performance-analyzer.git]

@github-actions
Copy link
Contributor

github-actions bot commented Sep 6, 2023

Gradle Check (Jenkins) Run Completed with:

Signed-off-by: Gaurav Chandani <chngau@amazon.com>
@github-actions
Copy link
Contributor

Gradle Check (Jenkins) Run Completed with:

@opensearch-trigger-bot opensearch-trigger-bot bot removed the stalled Issues that have stalled label Feb 19, 2024
Aman Khare added 2 commits February 27, 2024 13:59
Signed-off-by: Aman Khare <amkhar@amazon.com>
Signed-off-by: Aman Khare <amkhar@amazon.com>
Copy link
Contributor

@amkhar amkhar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, spotless apply will be applied after dependent PRs are merged.

Copy link
Contributor

❌ Gradle check result for 1ca219c: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

❌ Gradle check result for b230d16: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link

@khushbr khushbr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Aman Khare added 2 commits March 14, 2024 18:17
Signed-off-by: Aman Khare <amkhar@amazon.com>
Signed-off-by: Aman Khare <amkhar@amazon.com>
Copy link
Contributor

❌ Gradle check result for 1feb844: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

❌ Gradle check result for 272b972: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@amkhar
Copy link
Contributor

amkhar commented Mar 14, 2024

❌ Gradle check result for 272b972: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

testAdmissionControlRejectionEnforcedMode
testAdmissionControlRejectionMonitorOnlyMode

Flaky tests : #12664

Signed-off-by: Aman Khare <amkhar@amazon.com>
Copy link
Contributor

✅ Gradle check result for ddd088f: SUCCESS

Copy link

codecov bot commented Mar 14, 2024

Codecov Report

Attention: Patch coverage is 9.09091% with 20 lines in your changes are missing coverage. Please review.

Project coverage is 71.28%. Comparing base (b15cb0c) to head (ddd088f).
Report is 30 commits behind head on main.

Files Patch % Lines
.../opensearch/gateway/BaseGatewayShardAllocator.java 9.09% 20 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##               main    #8776      +/-   ##
============================================
- Coverage     71.42%   71.28%   -0.14%     
- Complexity    59978    60032      +54     
============================================
  Files          4985     4991       +6     
  Lines        282275   282657     +382     
  Branches      40946    40993      +47     
============================================
- Hits         201603   201502     -101     
- Misses        63999    64443     +444     
- Partials      16673    16712      +39     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@shwetathareja shwetathareja merged commit ef50fb4 into opensearch-project:main Mar 15, 2024
41 of 48 checks passed
rayshrey pushed a commit to rayshrey/OpenSearch that referenced this pull request Mar 18, 2024
…pensearch-project#8776)

* BaseGatewayShardAllocator changes for Assigning the batch of shards

Signed-off-by: Gaurav Chandani <chngau@amazon.com>
Co-authored-by: Aman Khare <amkhar@amazon.com>
ruai0511 pushed a commit to ruai0511/OpenSearch that referenced this pull request Mar 19, 2024
…pensearch-project#8776)

* BaseGatewayShardAllocator changes for Assigning the batch of shards

Signed-off-by: Gaurav Chandani <chngau@amazon.com>
Co-authored-by: Aman Khare <amkhar@amazon.com>
@shiv0408 shiv0408 added the backport 2.x Backport to 2.x branch label Mar 19, 2024
opensearch-trigger-bot bot pushed a commit that referenced this pull request Mar 19, 2024
…8776)

* BaseGatewayShardAllocator changes for Assigning the batch of shards

Signed-off-by: Gaurav Chandani <chngau@amazon.com>
Co-authored-by: Aman Khare <amkhar@amazon.com>
(cherry picked from commit ef50fb4)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
shwetathareja pushed a commit that referenced this pull request Mar 21, 2024
…8776) (#12773)

* BaseGatewayShardAllocator changes for Assigning the batch of shards



(cherry picked from commit ef50fb4)

Signed-off-by: Gaurav Chandani <chngau@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Aman Khare <amkhar@amazon.com>
opensearch-trigger-bot bot pushed a commit that referenced this pull request Mar 21, 2024
…8776) (#12773)

* BaseGatewayShardAllocator changes for Assigning the batch of shards

(cherry picked from commit ef50fb4)

Signed-off-by: Gaurav Chandani <chngau@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Aman Khare <amkhar@amazon.com>
(cherry picked from commit 41d11e1)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
shwetathareja pushed a commit that referenced this pull request Mar 21, 2024
…8776) (#12773) (#12810)

* BaseGatewayShardAllocator changes for Assigning the batch of shards

(cherry picked from commit ef50fb4)
(cherry picked from commit 41d11e1)

Signed-off-by: Gaurav Chandani <chngau@amazon.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Aman Khare <amkhar@amazon.com>
shiv0408 pushed a commit to Gaurav614/OpenSearch that referenced this pull request Apr 25, 2024
…pensearch-project#8776)

* BaseGatewayShardAllocator changes for Assigning the batch of shards

Signed-off-by: Gaurav Chandani <chngau@amazon.com>
Co-authored-by: Aman Khare <amkhar@amazon.com>
Signed-off-by: Shivansh Arora <hishiv@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: ✅ Done
Development

Successfully merging this pull request may close these issues.

7 participants