[Backport 2.x] Introduce cluster default remote translog buffer interval setting (#9584)

[ashking94]

Backport f5d3fd2 from #9584

[github-actions]

Compatibility status:

Checks if related components are compatible with change 7aaab87

Incompatible components

Incompatible components: [https://github.com/opensearch-project/performance-analyzer.git]

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/performance-analyzer-rca.git]

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.remotestore.RemoteStoreStatsIT.testStatsOnRemoteStoreRestore
      1 org.opensearch.remotestore.RemoteStoreStatsIT.classMethod

• URL: https://build.ci.opensearch.org/job/gradle-check/24310/
• CommitID: 7aaab87
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Merging #9723 (7aaab87) into 2.x (58ae69d) will increase coverage by 0.09%.
Report is 4 commits behind head on 2.x.
The diff coverage is 73.17%.

@@             Coverage Diff              @@
##                2.x    #9723      +/-   ##
============================================
+ Coverage     70.80%   70.90%   +0.09%     
- Complexity    57868    57931      +63     
============================================
  Files          4793     4794       +1     
  Lines        273397   273486      +89     
  Branches      40216    40228      +12     
============================================
+ Hits         193583   193907     +324     
+ Misses        63235    62980     -255     
- Partials      16579    16599      +20     

Files Changed	Coverage Δ
...rg/opensearch/common/settings/ClusterSettings.java	93.18% <ø> (ø)
...mmon/util/concurrent/BufferedAsyncIOProcessor.java	67.74% <0.00%> (-2.26%)	⬇️
...rc/main/java/org/opensearch/index/IndexModule.java	82.35% <ø> (ø)
...opensearch/index/SegmentReplicationShardStats.java	39.13% <40.00%> (+0.10%)	⬆️
...replication/common/SegmentReplicationLagTimer.java	40.00% <40.00%> (ø)
.../indices/replication/SegmentReplicationTarget.java	84.87% <68.18%> (-4.13%)	⬇️
...earch/index/SegmentReplicationPressureService.java	76.69% <69.23%> (-0.63%)	⬇️
.../replication/checkpoint/ReplicationCheckpoint.java	84.61% <72.72%> (-3.11%)	⬇️
...in/java/org/opensearch/index/shard/IndexShard.java	68.86% <75.00%> (+0.20%)	⬆️
...in/java/org/opensearch/indices/IndicesService.java	71.07% <75.00%> (+0.62%)	⬆️
... and 6 more

... and 450 files with indirect coverage changes

[ashking94]

org.opensearch.remotestore.RemoteStoreStatsIT.testStatsOnRemoteStoreRestore

Flaky test - #9724.