Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Remote Store] Add Segment download stats to remotestore stats API #8718

Merged
merged 52 commits into from
Aug 1, 2023
Merged

[Remote Store] Add Segment download stats to remotestore stats API #8718

merged 52 commits into from
Aug 1, 2023

Commits on Jul 5, 2023

  1. Adding Segment download stats to remotestore stats API 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    d1e688a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'opensearch-project:main' into segment-download-stats

    @shourya035
    shourya035 committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    8086eb9 View commit details
    Browse the repository at this point in the history

  3. Removed unused loggers and updated upload stats field names 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    97b733a View commit details
    Browse the repository at this point in the history

  4. Fixing spotless errors 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    e667270 View commit details
    Browse the repository at this point in the history

  5. Adding JavaDocs and fixing divide by zero errors on UTs 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    743c09a View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2023

  1. Merge branch 'opensearch-project:main' into segment-download-stats

    @shourya035
    shourya035 committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    94f0f58 View commit details
    Browse the repository at this point in the history

  2. Excluding stats publishing on non-remote store indices 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    ac3fbc0 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'opensearch-project:main' into segment-download-stats

    @shourya035
    shourya035 committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    bb20d64 View commit details
    Browse the repository at this point in the history

  4. Excluding stats publishing on non-remote store indices 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    b42912f View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2023

  1. Merge branch 'opensearch-project:main' into segment-download-stats

    @shourya035
    shourya035 committed Jul 7, 2023
    Configuration menu
    Copy the full SHA
    83f2bd6 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2023

  1. Removing unused logger 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    80cf62b View commit details
    Browse the repository at this point in the history

  2. Addressing comments 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    d826579 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'opensearch-project:main' into segment-download-stats

    @shourya035
    shourya035 committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    2213186 View commit details
    Browse the repository at this point in the history

  4. Fixing API field name from routing to shards 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    f282d54 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'opensearch-project:main' into segment-download-stats

    @shourya035
    shourya035 committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    331cb81 View commit details
    Browse the repository at this point in the history

  6. Changing file upload stats to sync level from file level 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    8de6d00 View commit details
    Browse the repository at this point in the history

  7. Retrigger integs 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 11, 2023
    Configuration menu
    Copy the full SHA
    9daeb74 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2023

  1. Empty Commit 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    d507ca8 View commit details
    Browse the repository at this point in the history

  2. Removing unused toString method 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    8c4d189 View commit details
    Browse the repository at this point in the history

  3. Merge from previous branch 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    27b6ad0 View commit details
    Browse the repository at this point in the history

  4. Removing unused window size vars 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    cdf9a49 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. Merge branch 'opensearch-project:main' into segment-download-stats-2

    @shourya035
    shourya035 committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    c4393b0 View commit details
    Browse the repository at this point in the history

  2. Adding Integ tests for download stats 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    b60bb40 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2023

  1. Merge branch 'main' into segment-download-stats-2 

    Signed-off-by: Shourya <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    67ca0b6 View commit details
    Browse the repository at this point in the history

  2. Addressing comments 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    c62926f View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into segment-download-stats-2 

    Signed-off-by: Shourya <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    cceb294 View commit details
    Browse the repository at this point in the history

  4. Adding more integ tests on stats correctness 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    0d00a79 View commit details
    Browse the repository at this point in the history

  5. Fixed Spotless checks 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    41497f3 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2023

  1. Addressing comments 

    Signed-off-by: Ashish Singh <ssashish@amazon.com>
    @ashking94
    ashking94 committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    7a4d993 View commit details
    Browse the repository at this point in the history

  2. Retrigger Integs 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    ac7df33 View commit details
    Browse the repository at this point in the history

  3. Retrigger Integs 2 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    70a60f2 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'opensearch-project:main' into segment-download-stats-2

    @shourya035
    shourya035 committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    2bcf467 View commit details
    Browse the repository at this point in the history

  5. Fixing assertion on Stats UT 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    df43b9c View commit details
    Browse the repository at this point in the history

  6. Fixing stats correctness test cases for RemoteStoreStatsIT 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    6e3d1da View commit details
    Browse the repository at this point in the history

  7. Fixing stats IT flakyness 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    bf43cb1 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. Merge branch 'opensearch-project:main' into segment-download-stats-2

    @shourya035
    shourya035 committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    b171ce9 View commit details
    Browse the repository at this point in the history

  2. Changing replica count on IT 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    6db95df View commit details
    Browse the repository at this point in the history

  3. Changing upper and lower bounds of random doc ingestion in IT 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    2d552b9 View commit details
    Browse the repository at this point in the history

  4. Addressing comments 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    edbfde3 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. Addressing comments 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    c1b447b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'opensearch-project:main' into segment-download-stats-2

    @shourya035
    shourya035 committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    684d463 View commit details
    Browse the repository at this point in the history

  3. Adding JavaDoc for new interface 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    d380d1d View commit details
    Browse the repository at this point in the history

  4. Manually invoking refresh on ITs 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    4a866ae View commit details
    Browse the repository at this point in the history

  5. Retrigger tests 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    91378d1 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. Abstracting out stats population logic to different class 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    e843adc View commit details
    Browse the repository at this point in the history

  2. Fixing UTs and removing repeated isRemoteStoreEnabled checks 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    7a2439d View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2023

  1. Merge branch 'opensearch-project:main' into segment-download-stats-2

    @shourya035
    shourya035 committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    877e98e View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. Merge branch 'opensearch-project:main' into segment-download-stats-2

    @shourya035
    shourya035 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    0d248cb View commit details
    Browse the repository at this point in the history

  2. Moving download stats population to StoreDirectory 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    8f8ed29 View commit details
    Browse the repository at this point in the history

  3. Fixing pressure service UTs and updating tracker javadocs 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    c54cd01 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. Merge branch 'opensearch-project:main' into segment-download-stats-2

    @shourya035
    shourya035 committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    6ce96a8 View commit details
    Browse the repository at this point in the history

  2. Addressing comments 

    Signed-off-by: Shourya Dutta Biswas <114977491+shourya035@users.noreply.github.com>
    @shourya035
    shourya035 committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    508eb22 View commit details
    Browse the repository at this point in the history