[Backport 2.x] Add capability to restrict async durability mode for remote indexes (#10189)

[ashking94]

Backport 53cffef from #10189

[ashking94]

The conflict came in the CHANGELOG.md file. All other conflicts were auto resolved.

[github-actions]

Compatibility status:

Checks if related components are compatible with change c9703c8

Incompatible components

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/performance-analyzer.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git]

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.snapshots.CloneSnapshotIT.testCloneShallowSnapshotIndex
      1 org.opensearch.remotestore.RemoteStoreStatsIT.testDownloadStatsCorrectnessSinglePrimarySingleReplica

• URL: https://build.ci.opensearch.org/job/gradle-check/26325/
• CommitID: c9703c8
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Merging #10235 (c9703c8) into 2.x (c1c1cee) will decrease coverage by 0.10%.
Report is 4 commits behind head on 2.x.
The diff coverage is 80.00%.

@@             Coverage Diff              @@
##                2.x   #10235      +/-   ##
============================================
- Coverage     70.88%   70.79%   -0.10%     
+ Complexity    58335    58277      -58     
============================================
  Files          4812     4812              
  Lines        275413   275418       +5     
  Branches      40489    40492       +3     
============================================
- Hits         195222   194969     -253     
- Misses        63525    63778     +253     
- Partials      16666    16671       +5     

Files	Coverage Δ
.../org/opensearch/ingest/common/RemoveProcessor.java	96.96% <100.00%> (+7.31%)	⬆️
...luster/metadata/MetadataUpdateSettingsService.java	70.37% <100.00%> (-0.91%)	⬇️
...rg/opensearch/common/settings/ClusterSettings.java	92.85% <ø> (ø)
...dex/translog/transfer/TranslogTransferManager.java	73.01% <ø> (-7.62%)	⬇️
...in/java/org/opensearch/indices/IndicesService.java	70.99% <100.00%> (+0.76%)	⬆️
...g/transfer/TranslogCheckpointTransferSnapshot.java	78.20% <0.00%> (-8.81%)	⬇️
...h/cluster/metadata/MetadataCreateIndexService.java	79.31% <70.00%> (-0.51%)	⬇️
...rg/opensearch/index/translog/RemoteFsTranslog.java	70.93% <75.00%> (-2.43%)	⬇️

... and 476 files with indirect coverage changes