> Task :buildSrc:reaper:compileJava UP-TO-DATE > Task :buildSrc:reaper:processResources NO-SOURCE > Task :buildSrc:reaper:classes UP-TO-DATE > Task :buildSrc:reaper:jar UP-TO-DATE > Task :buildSrc:reaper:assemble UP-TO-DATE > Task :buildSrc:reaper:compileTestJava NO-SOURCE > Task :buildSrc:reaper:processTestResources NO-SOURCE > Task :buildSrc:reaper:testClasses UP-TO-DATE > Task :buildSrc:reaper:test NO-SOURCE > Task :buildSrc:reaper:check UP-TO-DATE > Task :buildSrc:reaper:build UP-TO-DATE > Task :buildSrc:compileJava UP-TO-DATE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:generateVersionProperties UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestFixturesJava UP-TO-DATE > Task :buildSrc:compileTestFixturesGroovy NO-SOURCE > Task :buildSrc:processTestFixturesResources NO-SOURCE > Task :buildSrc:testFixturesClasses UP-TO-DATE > Task :buildSrc:testFixturesJar UP-TO-DATE > Task :buildSrc:compileTestJava UP-TO-DATE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources UP-TO-DATE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test SKIPPED > Task :buildSrc:validatePlugins UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE > Configure project :qa:os Cannot add task 'destructiveDistroTest.docker' as a task with that name already exists. ======================================= OpenSearch Build Hamster says Hello! Gradle Version : 7.3.3 OS Info : Linux 5.11.0-1022-aws (amd64) Runtime JDK Version : 17 (Eclipse Adoptium JDK) Runtime java.home : /home/ubuntu/sw/jdk-17.0.1+12 Gradle JDK Version : 11 (Eclipse Adoptium JDK) Gradle java.home : /home/ubuntu/sw/jdk-11.0.13+8 Random Testing Seed : 589B15FA746087E9 In FIPS 140 mode : false ======================================= > Task :server:generateModulesList UP-TO-DATE > Task :libs:opensearch-plugin-classloader:compileJava UP-TO-DATE > Task :libs:opensearch-secure-sm:compileJava UP-TO-DATE > Task :libs:opensearch-geo:compileJava UP-TO-DATE > Task :client:sniffer:processResources NO-SOURCE > Task :libs:opensearch-cli:processResources NO-SOURCE > Task :libs:opensearch-plugin-classloader:processResources NO-SOURCE > Task :libs:opensearch-nio:processResources NO-SOURCE > Task :libs:opensearch-secure-sm:processResources NO-SOURCE > Task :server:generatePluginsList UP-TO-DATE > Task :libs:opensearch-x-content:processResources NO-SOURCE > Task :test:framework:processResources UP-TO-DATE > Task :modules:analysis-common:processResources UP-TO-DATE > Task :modules:lang-painless:spi:processResources NO-SOURCE > Task :modules:lang-painless:processResources UP-TO-DATE > Task :libs:opensearch-dissect:compileJava UP-TO-DATE > Task :libs:opensearch-dissect:processResources NO-SOURCE > Task :modules:ingest-geoip:processResources NO-SOURCE > Task :modules:ingest-common:processResources UP-TO-DATE > Task :modules:lang-expression:processResources NO-SOURCE > Task :modules:lang-mustache:processResources NO-SOURCE > Task :modules:geo:processResources NO-SOURCE > Task :modules:parent-join:processResources UP-TO-DATE > Task :modules:percolator:processResources NO-SOURCE > Task :modules:parent-join:copyPluginPropertiesTemplate UP-TO-DATE > Task :modules:percolator:copyPluginPropertiesTemplate UP-TO-DATE > Task :modules:analysis-common:copyPluginPropertiesTemplate UP-TO-DATE > Task :modules:rank-eval:processResources UP-TO-DATE > Task :libs:opensearch-ssl-config:processResources NO-SOURCE > Task :modules:reindex:processResources NO-SOURCE > Task :modules:analysis-common:pluginProperties UP-TO-DATE > Task :modules:reindex:copyPluginPropertiesTemplate UP-TO-DATE > Task :modules:analysis-common:copyYamlTestsTask NO-SOURCE > Task :modules:transport-netty4:copyPluginPropertiesTemplate UP-TO-DATE > Task :modules:repository-url:processResources NO-SOURCE > Task :plugins:analysis-icu:processResources NO-SOURCE > Task :plugins:discovery-azure-classic:processResources NO-SOURCE > Task :plugins:discovery-ec2:processResources NO-SOURCE > Task :plugins:discovery-gce:processResources NO-SOURCE > Task :plugins:mapper-annotated-text:processResources NO-SOURCE > Task :plugins:mapper-size:processResources NO-SOURCE > Task :libs:opensearch-secure-sm:classes UP-TO-DATE > Task :plugins:repository-azure:processResources NO-SOURCE > Task :libs:opensearch-plugin-classloader:classes UP-TO-DATE > Task :test:fixtures:azure-fixture:processResources NO-SOURCE > Task :plugins:repository-gcs:processResources NO-SOURCE > Task :server:processResources UP-TO-DATE > Task :test:fixtures:gcs-fixture:processResources NO-SOURCE > Task :libs:opensearch-core:compileJava UP-TO-DATE > Task :plugins:repository-s3:processResources NO-SOURCE > Task :libs:opensearch-geo:processResources NO-SOURCE > Task :test:fixtures:minio-fixture:preProcessFixture SKIPPED > Task :test:fixtures:s3-fixture:processResources NO-SOURCE > Task :libs:opensearch-geo:classes UP-TO-DATE > Task :plugins:repository-s3:copyPluginPropertiesTemplate UP-TO-DATE > Task :plugins:store-smb:processResources NO-SOURCE > Task :libs:opensearch-core:processResources NO-SOURCE > Task :plugins:repository-azure:copyPluginPropertiesTemplate UP-TO-DATE > Task :libs:opensearch-nio:compileJava UP-TO-DATE > Task :plugins:mapper-size:copyPluginPropertiesTemplate UP-TO-DATE > Task :plugins:mapper-annotated-text:copyPluginPropertiesTemplate UP-TO-DATE > Task :plugins:mapper-size:pluginProperties UP-TO-DATE > Task :plugins:repository-gcs:copyPluginPropertiesTemplate UP-TO-DATE > Task :plugins:discovery-gce:copyPluginPropertiesTemplate UP-TO-DATE > Task :plugins:transport-nio:processResources NO-SOURCE > Task :plugins:discovery-ec2:copyPluginPropertiesTemplate UP-TO-DATE > Task :plugins:discovery-azure-classic:copyPluginPropertiesTemplate UP-TO-DATE > Task :plugins:analysis-icu:copyPluginPropertiesTemplate UP-TO-DATE > Task :modules:repository-url:copyPluginPropertiesTemplate UP-TO-DATE > Task :plugins:analysis-icu:pluginProperties UP-TO-DATE > Task :server:processTestResources UP-TO-DATE > Task :server:processInternalClusterTestResources NO-SOURCE > Task :modules:repository-url:pluginProperties UP-TO-DATE > Task :modules:repository-url:copyYamlTestsTask NO-SOURCE > Task :modules:transport-netty4:pluginProperties UP-TO-DATE > Task :libs:opensearch-plugin-classloader:jar UP-TO-DATE > Task :modules:rank-eval:copyPluginPropertiesTemplate UP-TO-DATE > Task :modules:reindex:pluginProperties UP-TO-DATE > Task :modules:percolator:pluginProperties UP-TO-DATE > Task :modules:percolator:copyYamlTestsTask NO-SOURCE > Task :modules:parent-join:pluginProperties UP-TO-DATE > Task :libs:opensearch-secure-sm:jar UP-TO-DATE > Task :libs:opensearch-ssl-config:compileJava UP-TO-DATE > Task :modules:lang-mustache:copyPluginPropertiesTemplate UP-TO-DATE > Task :modules:lang-expression:copyPluginPropertiesTemplate UP-TO-DATE > Task :libs:opensearch-ssl-config:classes UP-TO-DATE > Task :modules:ingest-common:copyPluginPropertiesTemplate UP-TO-DATE > Task :modules:ingest-geoip:copyPluginPropertiesTemplate UP-TO-DATE > Task :libs:opensearch-dissect:classes UP-TO-DATE > Task :modules:analysis-common:copyRestApiSpecsTask UP-TO-DATE > Task :modules:ingest-geoip:pluginProperties UP-TO-DATE > Task :modules:ingest-common:pluginProperties UP-TO-DATE > Task :modules:lang-expression:pluginProperties UP-TO-DATE > Task :modules:percolator:copyRestApiSpecsTask UP-TO-DATE > Task :modules:lang-mustache:pluginProperties UP-TO-DATE > Task :modules:parent-join:copyYamlTestsTask NO-SOURCE > Task :libs:opensearch-grok:compileJava UP-TO-DATE > Task :modules:reindex:copyParentJoinMetadata UP-TO-DATE > Task :modules:rank-eval:pluginProperties UP-TO-DATE > Task :modules:transport-netty4:processResources NO-SOURCE > Task :modules:rank-eval:copyYamlTestsTask NO-SOURCE > Task :libs:opensearch-grok:processResources UP-TO-DATE > Task :server:processJava11Resources NO-SOURCE > Task :client:rest:compileJava UP-TO-DATE > Task :plugins:analysis-icu:copyYamlTestsTask NO-SOURCE > Task :client:rest:processResources NO-SOURCE > Task :libs:opensearch-dissect:jar UP-TO-DATE > Task :libs:opensearch-ssl-config:jar UP-TO-DATE > Task :plugins:discovery-azure-classic:pluginProperties UP-TO-DATE > Task :plugins:discovery-azure-classic:copyYamlTestsTask NO-SOURCE > Task :plugins:transport-nio:copyPluginPropertiesTemplate UP-TO-DATE > Task :plugins:discovery-ec2:pluginProperties UP-TO-DATE > Task :client:sniffer:compileJava UP-TO-DATE > Task :plugins:discovery-ec2:copyYamlTestsTask NO-SOURCE > Task :plugins:discovery-gce:pluginProperties UP-TO-DATE > Task :plugins:transport-nio:pluginProperties UP-TO-DATE > Task :plugins:mapper-size:copyYamlTestsTask NO-SOURCE > Task :plugins:repository-gcs:pluginProperties UP-TO-DATE > Task :plugins:transport-nio:processTestResources UP-TO-DATE > Task :libs:opensearch-nio:classes UP-TO-DATE > Task :plugins:mapper-annotated-text:pluginProperties UP-TO-DATE > Task :libs:opensearch-core:classes UP-TO-DATE > Task :plugins:repository-azure:pluginProperties UP-TO-DATE > Task :modules:repository-url:copyRestApiSpecsTask UP-TO-DATE > Task :libs:opensearch-x-content:compileJava UP-TO-DATE > Task :plugins:repository-s3:pluginProperties UP-TO-DATE > Task :test:fixtures:minio-fixture:composeUp SKIPPED > Task :plugins:store-smb:copyPluginPropertiesTemplate UP-TO-DATE > Task :libs:opensearch-x-content:classes UP-TO-DATE > Task :libs:opensearch-core:compileJava11Java UP-TO-DATE > Task :plugins:repository-azure:copyYamlTestsTask NO-SOURCE > Task :plugins:mapper-annotated-text:copyYamlTestsTask NO-SOURCE > Task :plugins:store-smb:pluginProperties UP-TO-DATE > Task :libs:opensearch-cli:compileJava UP-TO-DATE > Task :plugins:transport-nio:processInternalClusterTestResources NO-SOURCE > Task :modules:repository-url:processTestResources UP-TO-DATE > Task :plugins:repository-gcs:copyYamlTestsTask NO-SOURCE > Task :plugins:discovery-gce:copyYamlTestsTask NO-SOURCE > Task :client:sniffer:classes UP-TO-DATE > Task :client:rest:classes UP-TO-DATE > Task :libs:opensearch-geo:jar UP-TO-DATE > Task :libs:opensearch-grok:classes UP-TO-DATE > Task :modules:transport-netty4:copyYamlTestsTask NO-SOURCE > Task :plugins:mapper-size:copyRestApiSpecsTask UP-TO-DATE > Task :modules:reindex:copyTransportNetty4Metadata UP-TO-DATE > Task :plugins:mapper-size:processTestResources NO-SOURCE > Task :modules:reindex:copyYamlTestsTask NO-SOURCE > Task :plugins:mapper-size:processInternalClusterTestResources NO-SOURCE > Task :libs:opensearch-nio:jar UP-TO-DATE > Task :modules:lang-mustache:copyYamlTestsTask NO-SOURCE > Task :modules:lang-expression:copyYamlTestsTask NO-SOURCE > Task :modules:ingest-common:copyYamlTestsTask NO-SOURCE > Task :modules:ingest-geoip:copyYamlTestsTask NO-SOURCE > Task :plugins:discovery-ec2:copyRestApiSpecsTask UP-TO-DATE > Task :modules:percolator:processTestResources UP-TO-DATE > Task :client:sniffer:jar UP-TO-DATE > Task :plugins:discovery-ec2:processTestResources UP-TO-DATE > Task :modules:analysis-common:processTestResources UP-TO-DATE > Task :plugins:discovery-azure-classic:copyRestApiSpecsTask UP-TO-DATE > Task :plugins:discovery-azure-classic:processTestResources UP-TO-DATE > Task :libs:opensearch-grok:jar UP-TO-DATE > Task :plugins:analysis-icu:copyRestApiSpecsTask UP-TO-DATE > Task :plugins:analysis-icu:processTestResources UP-TO-DATE > Task :modules:repository-url:processInternalClusterTestResources NO-SOURCE > Task :modules:rank-eval:copyRestApiSpecsTask UP-TO-DATE > Task :libs:opensearch-cli:classes UP-TO-DATE > Task :libs:opensearch-core:processJava11Resources NO-SOURCE > Task :plugins:store-smb:copyYamlTestsTask NO-SOURCE > Task :test:fixtures:minio-fixture:buildFixture SKIPPED > Task :libs:opensearch-core:java11Classes UP-TO-DATE > Task :plugins:repository-s3:copyYamlTestsTask NO-SOURCE > Task :modules:rank-eval:processTestResources NO-SOURCE > Task :plugins:analysis-icu:processInternalClusterTestResources NO-SOURCE > Task :modules:reindex:copyRestApiSpecsTask UP-TO-DATE > Task :plugins:discovery-azure-classic:createKey UP-TO-DATE > Task :client:rest:jar UP-TO-DATE > Task :modules:analysis-common:processInternalClusterTestResources NO-SOURCE > Task :plugins:discovery-ec2:processInternalClusterTestResources NO-SOURCE > Task :modules:percolator:processInternalClusterTestResources NO-SOURCE > Task :plugins:discovery-azure-classic:processInternalClusterTestResources UP-TO-DATE > Task :modules:parent-join:copyRestApiSpecsTask UP-TO-DATE > Task :modules:reindex:processTestResources UP-TO-DATE > Task :modules:reindex:processInternalClusterTestResources NO-SOURCE > Task :modules:rank-eval:processInternalClusterTestResources NO-SOURCE > Task :libs:opensearch-x-content:jar UP-TO-DATE > Task :modules:ingest-geoip:copyRestApiSpecsTask UP-TO-DATE > Task :test:fixtures:minio-fixture:postProcessFixture SKIPPED > Task :libs:opensearch-cli:jar UP-TO-DATE > Task :modules:parent-join:processTestResources NO-SOURCE > Task :modules:parent-join:processInternalClusterTestResources NO-SOURCE > Task :modules:ingest-common:copyRestApiSpecsTask UP-TO-DATE > Task :modules:ingest-common:processTestResources NO-SOURCE > Task :modules:ingest-common:processInternalClusterTestResources NO-SOURCE > Task :modules:ingest-geoip:processTestResources UP-TO-DATE > Task :modules:ingest-geoip:processInternalClusterTestResources NO-SOURCE > Task :modules:lang-expression:copyRestApiSpecsTask UP-TO-DATE > Task :modules:lang-expression:processTestResources UP-TO-DATE > Task :modules:lang-expression:processInternalClusterTestResources NO-SOURCE > Task :libs:opensearch-core:jar UP-TO-DATE > Task :modules:lang-mustache:copyRestApiSpecsTask UP-TO-DATE > Task :modules:lang-mustache:processTestResources UP-TO-DATE > Task :modules:transport-netty4:copyRestApiSpecsTask UP-TO-DATE > Task :modules:lang-mustache:processInternalClusterTestResources NO-SOURCE > Task :modules:transport-netty4:processTestResources UP-TO-DATE > Task :modules:transport-netty4:processInternalClusterTestResources NO-SOURCE > Task :plugins:discovery-gce:copyRestApiSpecsTask UP-TO-DATE > Task :plugins:repository-gcs:copyRestApiSpecsTask UP-TO-DATE > Task :plugins:discovery-gce:processTestResources UP-TO-DATE > Task :plugins:repository-gcs:processTestResources UP-TO-DATE > Task :plugins:discovery-gce:processInternalClusterTestResources NO-SOURCE > Task :plugins:repository-gcs:processInternalClusterTestResources NO-SOURCE > Task :plugins:mapper-annotated-text:copyRestApiSpecsTask UP-TO-DATE > Task :plugins:mapper-annotated-text:processTestResources NO-SOURCE > Task :plugins:mapper-annotated-text:processInternalClusterTestResources NO-SOURCE > Task :plugins:repository-azure:copyRestApiSpecsTask UP-TO-DATE > Task :plugins:repository-azure:processTestResources UP-TO-DATE > Task :plugins:repository-azure:processInternalClusterTestResources NO-SOURCE > Task :plugins:repository-s3:copyRestApiSpecsTask UP-TO-DATE > Task :plugins:repository-s3:processTestResources UP-TO-DATE > Task :plugins:repository-s3:processInternalClusterTestResources NO-SOURCE > Task :plugins:store-smb:copyRestApiSpecsTask UP-TO-DATE > Task :plugins:store-smb:processTestResources NO-SOURCE > Task :plugins:store-smb:processInternalClusterTestResources NO-SOURCE > Task :server:compileJava UP-TO-DATE > Task :server:classes UP-TO-DATE > Task :server:compileJava11Java UP-TO-DATE > Task :modules:percolator:compileJava UP-TO-DATE > Task :modules:geo:compileJava UP-TO-DATE > Task :modules:rank-eval:compileJava UP-TO-DATE > Task :modules:parent-join:compileJava UP-TO-DATE > Task :modules:lang-painless:spi:compileJava UP-TO-DATE > Task :modules:reindex:compileJava UP-TO-DATE > Task :modules:repository-url:compileJava UP-TO-DATE > Task :modules:reindex:classes UP-TO-DATE > Task :modules:repository-url:classes UP-TO-DATE > Task :modules:lang-painless:spi:classes UP-TO-DATE > Task :plugins:mapper-annotated-text:compileJava UP-TO-DATE > Task :modules:parent-join:classes UP-TO-DATE > Task :modules:geo:classes UP-TO-DATE > Task :plugins:mapper-size:compileJava UP-TO-DATE > Task :modules:percolator:classes UP-TO-DATE > Task :server:java11Classes UP-TO-DATE > Task :modules:rank-eval:classes UP-TO-DATE > Task :test:fixtures:azure-fixture:compileJava UP-TO-DATE > Task :plugins:mapper-size:classes UP-TO-DATE > Task :test:fixtures:azure-fixture:classes UP-TO-DATE > Task :test:fixtures:gcs-fixture:compileJava UP-TO-DATE > Task :plugins:mapper-annotated-text:classes UP-TO-DATE > Task :test:fixtures:azure-fixture:jar UP-TO-DATE > Task :test:fixtures:s3-fixture:compileJava UP-TO-DATE > Task :test:fixtures:s3-fixture:classes UP-TO-DATE > Task :plugins:store-smb:compileJava UP-TO-DATE > Task :plugins:store-smb:classes UP-TO-DATE > Task :test:fixtures:s3-fixture:jar UP-TO-DATE > Task :test:fixtures:gcs-fixture:classes UP-TO-DATE > Task :test:fixtures:gcs-fixture:jar UP-TO-DATE > Task :plugins:analysis-icu:compileJava UP-TO-DATE > Task :plugins:analysis-icu:classes UP-TO-DATE > Task :modules:geo:jar UP-TO-DATE > Task :modules:parent-join:jar UP-TO-DATE > Task :plugins:discovery-ec2:compileJava UP-TO-DATE > Task :plugins:discovery-ec2:classes UP-TO-DATE > Task :modules:lang-painless:spi:jar UP-TO-DATE > Task :modules:lang-mustache:compileJava UP-TO-DATE > Task :modules:lang-mustache:classes UP-TO-DATE > Task :modules:lang-expression:compileJava UP-TO-DATE > Task :modules:lang-expression:classes UP-TO-DATE > Task :modules:ingest-geoip:compileJava UP-TO-DATE > Task :modules:ingest-geoip:classes UP-TO-DATE > Task :modules:transport-netty4:compileJava UP-TO-DATE > Task :modules:transport-netty4:classes UP-TO-DATE > Task :plugins:repository-s3:compileJava UP-TO-DATE > Task :plugins:transport-nio:compileJava UP-TO-DATE > Task :plugins:discovery-azure-classic:compileJava UP-TO-DATE > Task :plugins:discovery-gce:compileJava UP-TO-DATE > Task :plugins:discovery-azure-classic:classes UP-TO-DATE > Task :plugins:discovery-gce:classes UP-TO-DATE > Task :plugins:transport-nio:classes UP-TO-DATE > Task :plugins:repository-s3:classes UP-TO-DATE > Task :test:framework:compileJava UP-TO-DATE > Task :plugins:repository-gcs:compileJava UP-TO-DATE > Task :plugins:repository-gcs:classes UP-TO-DATE > Task :modules:lang-painless:compileJava UP-TO-DATE > Task :modules:lang-painless:classes UP-TO-DATE > Task :test:framework:classes UP-TO-DATE > Task :plugins:discovery-azure-classic:compileTestJava NO-SOURCE > Task :modules:transport-netty4:jar UP-TO-DATE > Task :server:jar UP-TO-DATE > Task :plugins:mapper-size:compileTestJava NO-SOURCE > Task :test:fixtures:azure-fixture:preProcessFixture SKIPPED > Task :plugins:mapper-size:testClasses UP-TO-DATE > Task :modules:lang-painless:jar UP-TO-DATE > Task :test:fixtures:gcs-fixture:preProcessFixture SKIPPED > Task :test:fixtures:s3-fixture:preProcessFixture SKIPPED > Task :modules:ingest-common:compileJava UP-TO-DATE > Task :modules:analysis-common:compileJava UP-TO-DATE > Task :test:fixtures:gcs-fixture:composeUp SKIPPED > Task :test:fixtures:azure-fixture:composeUp SKIPPED > Task :test:fixtures:azure-fixture:buildFixture SKIPPED > Task :plugins:discovery-azure-classic:testClasses UP-TO-DATE > Task :modules:lang-expression:compileTestJava UP-TO-DATE > Task :modules:lang-expression:testClasses UP-TO-DATE > Task :modules:lang-mustache:compileTestJava UP-TO-DATE > Task :modules:parent-join:compileTestJava UP-TO-DATE > Task :modules:percolator:compileTestJava UP-TO-DATE > Task :modules:percolator:testClasses UP-TO-DATE > Task :modules:rank-eval:compileTestJava UP-TO-DATE > Task :modules:repository-url:compileTestJava UP-TO-DATE > Task :modules:rank-eval:testClasses UP-TO-DATE > Task :modules:repository-url:testClasses UP-TO-DATE > Task :plugins:analysis-icu:compileTestJava UP-TO-DATE > Task :plugins:analysis-icu:testClasses UP-TO-DATE > Task :plugins:discovery-ec2:compileTestJava UP-TO-DATE > Task :modules:reindex:compileTestJava UP-TO-DATE > Task :plugins:discovery-ec2:testClasses UP-TO-DATE > Task :modules:reindex:testClasses UP-TO-DATE > Task :plugins:mapper-annotated-text:compileTestJava UP-TO-DATE > Task :plugins:discovery-gce:compileTestJava UP-TO-DATE > Task :plugins:discovery-gce:testClasses UP-TO-DATE > Task :plugins:repository-gcs:compileTestJava UP-TO-DATE > Task :plugins:mapper-annotated-text:testClasses UP-TO-DATE > Task :plugins:repository-gcs:testClasses UP-TO-DATE > Task :plugins:repository-s3:compileTestJava UP-TO-DATE > Task :plugins:store-smb:compileTestJava UP-TO-DATE > Task :plugins:store-smb:testClasses UP-TO-DATE > Task :plugins:transport-nio:compileTestJava UP-TO-DATE > Task :plugins:mapper-size:compileInternalClusterTestJava UP-TO-DATE > Task :plugins:discovery-azure-classic:compileInternalClusterTestJava UP-TO-DATE > Task :modules:parent-join:testClasses UP-TO-DATE > Task :modules:lang-mustache:testClasses UP-TO-DATE > Task :modules:lang-expression:compileInternalClusterTestJava UP-TO-DATE > Task :test:fixtures:azure-fixture:postProcessFixture SKIPPED > Task :test:fixtures:gcs-fixture:buildFixture SKIPPED > Task :modules:analysis-common:classes UP-TO-DATE > Task :test:fixtures:gcs-fixture:postProcessFixture SKIPPED > Task :modules:percolator:compileInternalClusterTestJava UP-TO-DATE > Task :modules:ingest-common:classes UP-TO-DATE > Task :modules:transport-netty4:compileTestJava UP-TO-DATE > Task :test:fixtures:s3-fixture:composeUp SKIPPED > Task :modules:percolator:internalClusterTestClasses UP-TO-DATE > Task :modules:lang-expression:internalClusterTestClasses UP-TO-DATE > Task :modules:repository-url:compileInternalClusterTestJava UP-TO-DATE > Task :plugins:discovery-azure-classic:internalClusterTestClasses UP-TO-DATE > Task :modules:repository-url:internalClusterTestClasses UP-TO-DATE > Task :plugins:mapper-size:internalClusterTestClasses UP-TO-DATE > Task :plugins:transport-nio:testClasses UP-TO-DATE > Task :plugins:repository-s3:testClasses UP-TO-DATE > Task :plugins:discovery-gce:compileInternalClusterTestJava UP-TO-DATE > Task :modules:reindex:compileInternalClusterTestJava UP-TO-DATE > Task :modules:reindex:internalClusterTestClasses UP-TO-DATE > Task :plugins:discovery-gce:internalClusterTestClasses UP-TO-DATE > Task :test:framework:jar UP-TO-DATE > Task :plugins:repository-gcs:compileInternalClusterTestJava UP-TO-DATE > Task :plugins:analysis-icu:compileInternalClusterTestJava UP-TO-DATE > Task :modules:ingest-geoip:compileTestJava UP-TO-DATE > Task :plugins:store-smb:compileInternalClusterTestJava UP-TO-DATE > Task :plugins:discovery-ec2:compileInternalClusterTestJava UP-TO-DATE > Task :modules:rank-eval:compileInternalClusterTestJava UP-TO-DATE > Task :modules:lang-mustache:compileInternalClusterTestJava UP-TO-DATE > Task :test:fixtures:s3-fixture:buildFixture SKIPPED > Task :modules:analysis-common:compileTestJava UP-TO-DATE > Task :modules:transport-netty4:testClasses UP-TO-DATE > Task :modules:analysis-common:testClasses UP-TO-DATE > Task :modules:lang-mustache:internalClusterTestClasses UP-TO-DATE > Task :plugins:repository-azure:compileJava UP-TO-DATE > Task :plugins:transport-nio:compileInternalClusterTestJava UP-TO-DATE > Task :modules:rank-eval:internalClusterTestClasses UP-TO-DATE > Task :plugins:transport-nio:internalClusterTestClasses UP-TO-DATE > Task :plugins:store-smb:internalClusterTestClasses UP-TO-DATE > Task :plugins:discovery-ec2:internalClusterTestClasses UP-TO-DATE > Task :modules:ingest-geoip:testClasses UP-TO-DATE > Task :plugins:repository-s3:compileInternalClusterTestJava UP-TO-DATE > Task :plugins:analysis-icu:internalClusterTestClasses UP-TO-DATE > Task :plugins:repository-gcs:internalClusterTestClasses UP-TO-DATE > Task :modules:parent-join:compileInternalClusterTestJava UP-TO-DATE > Task :modules:ingest-common:compileTestJava UP-TO-DATE > Task :plugins:repository-gcs:internalClusterTest SKIPPED > Task :modules:ingest-common:testClasses UP-TO-DATE > Task :plugins:mapper-annotated-text:compileInternalClusterTestJava UP-TO-DATE > Task :plugins:mapper-annotated-text:internalClusterTestClasses UP-TO-DATE > Task :test:fixtures:gcs-fixture:composeDown SKIPPED > Task :modules:parent-join:internalClusterTestClasses UP-TO-DATE > Task :plugins:repository-s3:internalClusterTestClasses UP-TO-DATE > Task :modules:analysis-common:compileInternalClusterTestJava UP-TO-DATE > Task :plugins:repository-azure:classes UP-TO-DATE > Task :modules:ingest-geoip:compileInternalClusterTestJava UP-TO-DATE > Task :test:fixtures:s3-fixture:postProcessFixture SKIPPED > Task :modules:ingest-geoip:internalClusterTestClasses UP-TO-DATE > Task :modules:analysis-common:internalClusterTestClasses UP-TO-DATE > Task :modules:ingest-common:compileInternalClusterTestJava UP-TO-DATE > Task :modules:ingest-common:internalClusterTestClasses UP-TO-DATE > Task :plugins:repository-s3:internalClusterTest SKIPPED > Task :test:fixtures:s3-fixture:composeDown SKIPPED > Task :test:fixtures:minio-fixture:composeDown SKIPPED > Task :plugins:repository-azure:compileTestJava UP-TO-DATE > Task :plugins:repository-azure:testClasses UP-TO-DATE > Task :modules:transport-netty4:compileInternalClusterTestJava UP-TO-DATE > Task :modules:transport-netty4:internalClusterTestClasses UP-TO-DATE > Task :plugins:repository-azure:compileInternalClusterTestJava UP-TO-DATE > Task :plugins:repository-azure:internalClusterTestClasses UP-TO-DATE > Task :plugins:repository-azure:internalClusterTest SKIPPED > Task :test:fixtures:azure-fixture:composeDown SKIPPED > Task :server:compileTestJava UP-TO-DATE > Task :server:testClasses UP-TO-DATE > Task :server:compileInternalClusterTestJava UP-TO-DATE > Task :server:internalClusterTestClasses UP-TO-DATE > Task :modules:repository-url:urlFixture > Task :plugins:discovery-ec2:internalClusterTest > Task :plugins:mapper-annotated-text:internalClusterTest OpenJDK 64-Bit Server VM warning: Ignoring option --illegal-access=warn; support was removed in 17.0 > Task :modules:repository-url:urlFixture#stop > Task :plugins:mapper-annotated-text:internalClusterTest WARNING: A terminally deprecated method in java.lang.System has been called WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.BootstrapForTesting (file:/home/ubuntu/os/OpenSearch/test/framework/build/distributions/framework-2.0.0-SNAPSHOT.jar) WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.BootstrapForTesting WARNING: System::setSecurityManager will be removed in a future release WARNING: A terminally deprecated method in java.lang.System has been called WARNING: System::setSecurityManager has been called by org.gradle.api.internal.tasks.testing.worker.TestWorker (file:/home/ubuntu/.gradle/wrapper/dists/gradle-7.3.3-all/4295vidhdd9hd3gbjyw1xqxpo/gradle-7.3.3/lib/plugins/gradle-testing-base-7.3.3.jar) WARNING: Please consider reporting this to the maintainers of org.gradle.api.internal.tasks.testing.worker.TestWorker WARNING: System::setSecurityManager will be removed in a future release > Task :plugins:discovery-gce:internalClusterTest > Task :modules:repository-url:internalClusterTest OpenJDK 64-Bit Server VM warning: Ignoring option --illegal-access=warn; support was removed in 17.0 WARNING: A terminally deprecated method in java.lang.System has been called WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.BootstrapForTesting (file:/home/ubuntu/os/OpenSearch/test/framework/build/distributions/framework-2.0.0-SNAPSHOT.jar) WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.BootstrapForTesting WARNING: System::setSecurityManager will be removed in a future release > Task :plugins:discovery-azure-classic:internalClusterTest > Task :plugins:transport-nio:internalClusterTest > Task :plugins:store-smb:internalClusterTest > Task :modules:analysis-common:internalClusterTest > Task :plugins:mapper-size:internalClusterTest > Task :modules:lang-expression:internalClusterTest > Task :modules:percolator:internalClusterTest > Task :modules:lang-mustache:internalClusterTest > Task :modules:reindex:internalClusterTest > Task :plugins:analysis-icu:internalClusterTest > Task :modules:rank-eval:internalClusterTest > Task :modules:ingest-geoip:internalClusterTest > Task :modules:parent-join:internalClusterTest > Task :modules:ingest-common:internalClusterTest > Task :modules:transport-netty4:internalClusterTest > Task :server:internalClusterTest > Task :modules:repository-url:internalClusterTest WARNING: A terminally deprecated method in java.lang.System has been called WARNING: System::setSecurityManager has been called by org.gradle.api.internal.tasks.testing.worker.TestWorker (file:/home/ubuntu/.gradle/wrapper/dists/gradle-7.3.3-all/4295vidhdd9hd3gbjyw1xqxpo/gradle-7.3.3/lib/plugins/gradle-testing-base-7.3.3.jar) WARNING: Please consider reporting this to the maintainers of org.gradle.api.internal.tasks.testing.worker.TestWorker WARNING: System::setSecurityManager will be removed in a future release > Task :server:internalClusterTest REPRODUCE WITH: ./gradlew ':server:internalClusterTest' --tests "org.opensearch.index.ShardIndexingPressureSettingsIT.testShardIndexingPressureEnforcedEnabledDisabledSetting" -Dtests.seed=589B15FA746087E9 -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=zh-HK -Dtests.timezone=US/Mountain -Druntime.java=17 org.opensearch.index.ShardIndexingPressureSettingsIT > testShardIndexingPressureEnforcedEnabledDisabledSetting FAILED java.lang.Exception: Test abandoned because suite timeout was reached. at __randomizedtesting.SeedInfo.seed([589B15FA746087E9]:0) REPRODUCE WITH: ./gradlew ':server:internalClusterTest' --tests "org.opensearch.index.ShardIndexingPressureSettingsIT.testShardIndexingPressureEnforcedEnabledDisabledSetting" -Dtests.seed=589B15FA746087E9 -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=zh-HK -Dtests.timezone=US/Mountain -Druntime.java=17 org.opensearch.index.ShardIndexingPressureSettingsIT > classMethod FAILED java.lang.Exception: Suite timeout exceeded (>= 600000 msec). at __randomizedtesting.SeedInfo.seed([589B15FA746087E9]:0) Suite: Test class org.opensearch.index.ShardIndexingPressureSettingsIT 1> [2022-01-15T09:37:37,359][INFO ][o.o.i.ShardIndexingPressureSettingsIT] [testShardIndexingPressureEnforcedEnabledDisabledSetting] before test 1> [2022-01-15T09:37:37,364][INFO ][o.o.i.ShardIndexingPressureSettingsIT] [testShardIndexingPressureEnforcedEnabledDisabledSetting] [ShardIndexingPressureSettingsIT#testShardIndexingPressureEnforcedEnabledDisabledSetting]: setting up test 1> [2022-01-15T09:37:37,365][INFO ][o.o.t.InternalTestCluster] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Setup InternalTestCluster [TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster] with seed [D240248DD861006E] using [0] dedicated masters, [2] (data) nodes and [1] coord only nodes (min_master_nodes are [auto-managed]) 1> [2022-01-15T09:37:37,367][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] version[2.0.0], pid[3888272], build[unknown/unknown/unknown], OS[Linux/5.11.0-1022-aws/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.1/17.0.1+12] 1> [2022-01-15T09:37:37,367][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] JVM home [/home/ubuntu/sw/jdk-17.0.1+12] 1> [2022-01-15T09:37:37,367][DEPRECATION][o.o.d.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] no-jdk distributions that do not bundle a JDK are deprecated and will be removed in a future release 1> [2022-01-15T09:37:37,367][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] JVM arguments [-Dgradle.dist.lib=/home/ubuntu/.gradle/wrapper/dists/gradle-7.3.3-all/4295vidhdd9hd3gbjyw1xqxpo/gradle-7.3.3/lib, -Dgradle.user.home=/home/ubuntu/.gradle, -Dgradle.worker.jar=/home/ubuntu/.gradle/caches/7.3.3/workerMain/gradle-worker.jar, -Dio.netty.noKeySetOptimization=true, -Dio.netty.noUnsafe=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Djava.awt.headless=true, -Djava.locale.providers=SPI,COMPAT, -Djna.nosys=true, -Dopensearch.scripting.update.ctx_in_params=false, -Dopensearch.search.rewrite_sort=true, -Dopensearch.transport.cname_in_publish_address=true, -Dorg.gradle.internal.worker.tmpdir=/home/ubuntu/os/OpenSearch/server/build/tmp/internalClusterTest/work, -Dorg.gradle.native=false, -Dtests.artifact=server, -Dtests.gradle=true, -Dtests.jvm.argline=-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m, -Dtests.logger.level=WARN, -Dtests.security.manager=true, -Dtests.seed=589B15FA746087E9, -Dtests.task=:server:internalClusterTest, -XX:+HeapDumpOnOutOfMemoryError, -XX:ReservedCodeCacheSize=64m, -esa, --illegal-access=warn, -XX:HeapDumpPath=/home/ubuntu/os/OpenSearch/server/build/heapdump, -javaagent:../../tmp/expandedArchives/org.jacoco.agent-0.8.7.jar_3a83c50b4a016f281c4e9f3500d16b55/jacocoagent.jar=destfile=../../jacoco/internalClusterTest.exec,append=true,inclnolocationclasses=false,dumponexit=true,output=file,jmx=false, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, -Xms512m, -Xmx512m, -Dfile.encoding=UTF-8, -Djava.io.tmpdir=/home/ubuntu/os/OpenSearch/server/build/testrun/internalClusterTest/temp, -Duser.country, -Duser.language=en, -Duser.variant, -ea] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] no modules loaded 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.index.MockEngineFactoryPlugin] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.index.mapper.MockFieldFilterPlugin] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.node.NodeMocksPlugin] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.script.MockScriptService$TestPlugin] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.search.MockSearchService$TestPlugin] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.InternalSettingsPlugin] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.MockHttpTransport$TestPlugin] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.OpenSearchIntegTestCase$AssertActionNamePlugin] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.OpenSearchIntegTestCase$TestSeedPlugin] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.TestGeoShapeFieldMapperPlugin] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.store.MockFSIndexStore$TestPlugin] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.transport.MockTransportService$TestPlugin] 1> [2022-01-15T09:37:37,368][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.transport.nio.MockNioTransportPlugin] 1> [2022-01-15T09:37:37,375][INFO ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using [1] data paths, mounts [[/ (/dev/root)]], net usable_space [93.4gb], net total_space [116.2gb], types [ext4] 1> [2022-01-15T09:37:37,375][INFO ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] heap size [512mb], compressed ordinary object pointers [true] 1> [2022-01-15T09:37:37,380][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] node name [node_t0], node ID [IdHo1pXgRVSr0AV5_fAddg], cluster name [TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster], roles [master, remote_cluster_client, data, ingest] 1> [2022-01-15T09:37:37,398][INFO ][o.o.d.DiscoveryModule ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using discovery type [zen] and seed hosts providers [settings, file] 1> [2022-01-15T09:37:37,406][WARN ][o.o.g.DanglingIndicesState] [testShardIndexingPressureEnforcedEnabledDisabledSetting] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually 1> [2022-01-15T09:37:37,413][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] initialized 1> [2022-01-15T09:37:37,414][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] version[2.0.0], pid[3888272], build[unknown/unknown/unknown], OS[Linux/5.11.0-1022-aws/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.1/17.0.1+12] 1> [2022-01-15T09:37:37,414][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] JVM home [/home/ubuntu/sw/jdk-17.0.1+12] 1> [2022-01-15T09:37:37,414][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] JVM arguments [-Dgradle.dist.lib=/home/ubuntu/.gradle/wrapper/dists/gradle-7.3.3-all/4295vidhdd9hd3gbjyw1xqxpo/gradle-7.3.3/lib, -Dgradle.user.home=/home/ubuntu/.gradle, -Dgradle.worker.jar=/home/ubuntu/.gradle/caches/7.3.3/workerMain/gradle-worker.jar, -Dio.netty.noKeySetOptimization=true, -Dio.netty.noUnsafe=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Djava.awt.headless=true, -Djava.locale.providers=SPI,COMPAT, -Djna.nosys=true, -Dopensearch.scripting.update.ctx_in_params=false, -Dopensearch.search.rewrite_sort=true, -Dopensearch.transport.cname_in_publish_address=true, -Dorg.gradle.internal.worker.tmpdir=/home/ubuntu/os/OpenSearch/server/build/tmp/internalClusterTest/work, -Dorg.gradle.native=false, -Dtests.artifact=server, -Dtests.gradle=true, -Dtests.jvm.argline=-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m, -Dtests.logger.level=WARN, -Dtests.security.manager=true, -Dtests.seed=589B15FA746087E9, -Dtests.task=:server:internalClusterTest, -XX:+HeapDumpOnOutOfMemoryError, -XX:ReservedCodeCacheSize=64m, -esa, --illegal-access=warn, -XX:HeapDumpPath=/home/ubuntu/os/OpenSearch/server/build/heapdump, -javaagent:../../tmp/expandedArchives/org.jacoco.agent-0.8.7.jar_3a83c50b4a016f281c4e9f3500d16b55/jacocoagent.jar=destfile=../../jacoco/internalClusterTest.exec,append=true,inclnolocationclasses=false,dumponexit=true,output=file,jmx=false, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, -Xms512m, -Xmx512m, -Dfile.encoding=UTF-8, -Djava.io.tmpdir=/home/ubuntu/os/OpenSearch/server/build/testrun/internalClusterTest/temp, -Duser.country, -Duser.language=en, -Duser.variant, -ea] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] no modules loaded 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.index.MockEngineFactoryPlugin] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.index.mapper.MockFieldFilterPlugin] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.node.NodeMocksPlugin] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.script.MockScriptService$TestPlugin] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.search.MockSearchService$TestPlugin] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.InternalSettingsPlugin] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.MockHttpTransport$TestPlugin] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.OpenSearchIntegTestCase$AssertActionNamePlugin] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.OpenSearchIntegTestCase$TestSeedPlugin] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.TestGeoShapeFieldMapperPlugin] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.store.MockFSIndexStore$TestPlugin] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.transport.MockTransportService$TestPlugin] 1> [2022-01-15T09:37:37,415][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.transport.nio.MockNioTransportPlugin] 1> [2022-01-15T09:37:37,423][INFO ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using [1] data paths, mounts [[/ (/dev/root)]], net usable_space [93.4gb], net total_space [116.2gb], types [ext4] 1> [2022-01-15T09:37:37,423][INFO ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] heap size [512mb], compressed ordinary object pointers [true] 1> [2022-01-15T09:37:37,434][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] node name [node_t1], node ID [UnDoZ4G8SQOOwTd1w6R1dg], cluster name [TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster], roles [master, remote_cluster_client, data, ingest] 1> [2022-01-15T09:37:37,448][INFO ][o.o.d.DiscoveryModule ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using discovery type [zen] and seed hosts providers [settings, file] 1> [2022-01-15T09:37:37,457][WARN ][o.o.g.DanglingIndicesState] [testShardIndexingPressureEnforcedEnabledDisabledSetting] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually 1> [2022-01-15T09:37:37,468][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] initialized 1> [2022-01-15T09:37:37,470][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] version[2.0.0], pid[3888272], build[unknown/unknown/unknown], OS[Linux/5.11.0-1022-aws/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.1/17.0.1+12] 1> [2022-01-15T09:37:37,470][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] JVM home [/home/ubuntu/sw/jdk-17.0.1+12] 1> [2022-01-15T09:37:37,470][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] JVM arguments [-Dgradle.dist.lib=/home/ubuntu/.gradle/wrapper/dists/gradle-7.3.3-all/4295vidhdd9hd3gbjyw1xqxpo/gradle-7.3.3/lib, -Dgradle.user.home=/home/ubuntu/.gradle, -Dgradle.worker.jar=/home/ubuntu/.gradle/caches/7.3.3/workerMain/gradle-worker.jar, -Dio.netty.noKeySetOptimization=true, -Dio.netty.noUnsafe=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Djava.awt.headless=true, -Djava.locale.providers=SPI,COMPAT, -Djna.nosys=true, -Dopensearch.scripting.update.ctx_in_params=false, -Dopensearch.search.rewrite_sort=true, -Dopensearch.transport.cname_in_publish_address=true, -Dorg.gradle.internal.worker.tmpdir=/home/ubuntu/os/OpenSearch/server/build/tmp/internalClusterTest/work, -Dorg.gradle.native=false, -Dtests.artifact=server, -Dtests.gradle=true, -Dtests.jvm.argline=-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m, -Dtests.logger.level=WARN, -Dtests.security.manager=true, -Dtests.seed=589B15FA746087E9, -Dtests.task=:server:internalClusterTest, -XX:+HeapDumpOnOutOfMemoryError, -XX:ReservedCodeCacheSize=64m, -esa, --illegal-access=warn, -XX:HeapDumpPath=/home/ubuntu/os/OpenSearch/server/build/heapdump, -javaagent:../../tmp/expandedArchives/org.jacoco.agent-0.8.7.jar_3a83c50b4a016f281c4e9f3500d16b55/jacocoagent.jar=destfile=../../jacoco/internalClusterTest.exec,append=true,inclnolocationclasses=false,dumponexit=true,output=file,jmx=false, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, -Xms512m, -Xmx512m, -Dfile.encoding=UTF-8, -Djava.io.tmpdir=/home/ubuntu/os/OpenSearch/server/build/testrun/internalClusterTest/temp, -Duser.country, -Duser.language=en, -Duser.variant, -ea] 1> [2022-01-15T09:37:37,473][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] no modules loaded 1> [2022-01-15T09:37:37,473][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.index.MockEngineFactoryPlugin] 1> [2022-01-15T09:37:37,473][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.index.mapper.MockFieldFilterPlugin] 1> [2022-01-15T09:37:37,473][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.node.NodeMocksPlugin] 1> [2022-01-15T09:37:37,473][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.script.MockScriptService$TestPlugin] 1> [2022-01-15T09:37:37,473][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.search.MockSearchService$TestPlugin] 1> [2022-01-15T09:37:37,473][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.InternalSettingsPlugin] 1> [2022-01-15T09:37:37,473][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.MockHttpTransport$TestPlugin] 1> [2022-01-15T09:37:37,473][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.OpenSearchIntegTestCase$AssertActionNamePlugin] 1> [2022-01-15T09:37:37,474][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.OpenSearchIntegTestCase$TestSeedPlugin] 1> [2022-01-15T09:37:37,474][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.TestGeoShapeFieldMapperPlugin] 1> [2022-01-15T09:37:37,474][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.store.MockFSIndexStore$TestPlugin] 1> [2022-01-15T09:37:37,474][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.transport.MockTransportService$TestPlugin] 1> [2022-01-15T09:37:37,474][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.transport.nio.MockNioTransportPlugin] 1> [2022-01-15T09:37:37,478][INFO ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using [1] data paths, mounts [[/ (/dev/root)]], net usable_space [93.4gb], net total_space [116.2gb], types [ext4] 1> [2022-01-15T09:37:37,478][INFO ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] heap size [512mb], compressed ordinary object pointers [true] 1> [2022-01-15T09:37:37,482][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] node name [node_t2], node ID [Isf3pfW-Q8e_iljeimAAUQ], cluster name [TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster], roles [] 1> [2022-01-15T09:37:37,505][INFO ][o.o.d.DiscoveryModule ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using discovery type [zen] and seed hosts providers [settings, file] 1> [2022-01-15T09:37:37,519][WARN ][o.o.g.DanglingIndicesState] [testShardIndexingPressureEnforcedEnabledDisabledSetting] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually 1> [2022-01-15T09:37:37,550][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] initialized 1> [2022-01-15T09:37:37,551][INFO ][o.o.n.Node ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#1]]] starting ... 1> [2022-01-15T09:37:37,551][INFO ][o.o.n.Node ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#2]]] starting ... 1> [2022-01-15T09:37:37,551][INFO ][o.o.n.Node ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#3]]] starting ... 1> [2022-01-15T09:37:37,554][INFO ][o.o.t.TransportService ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#3]]] publish_address {127.0.0.1:39183}, bound_addresses {[::1]:43549}, {127.0.0.1:39183} 1> [2022-01-15T09:37:37,554][INFO ][o.o.t.TransportService ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#1]]] publish_address {127.0.0.1:38465}, bound_addresses {[::1]:39261}, {127.0.0.1:38465} 1> [2022-01-15T09:37:37,554][INFO ][o.o.t.TransportService ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#2]]] publish_address {127.0.0.1:42167}, bound_addresses {[::1]:46535}, {127.0.0.1:42167} 1> [2022-01-15T09:37:37,630][INFO ][o.o.c.c.Coordinator ] [node_t1] setting initial configuration to VotingConfiguration{UnDoZ4G8SQOOwTd1w6R1dg,IdHo1pXgRVSr0AV5_fAddg} 1> [2022-01-15T09:37:37,749][INFO ][o.o.c.s.MasterService ] [node_t1] elected-as-master ([2] nodes joined)[{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true} elect leader, {node_t0}{IdHo1pXgRVSr0AV5_fAddg}{D8mUTfrzTkq29lqQidfx_Q}{127.0.0.1}{127.0.0.1:38465}{dimr}{shard_indexing_pressure_enabled=true} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, delta: master node changed {previous [], current [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true}]}, added {{node_t0}{IdHo1pXgRVSr0AV5_fAddg}{D8mUTfrzTkq29lqQidfx_Q}{127.0.0.1}{127.0.0.1:38465}{dimr}{shard_indexing_pressure_enabled=true}} 1> [2022-01-15T09:37:37,771][INFO ][o.o.c.c.CoordinationState] [node_t0] cluster UUID set to [U63EuObeSwit6KvbAzBIRg] 1> [2022-01-15T09:37:37,771][INFO ][o.o.c.c.CoordinationState] [node_t1] cluster UUID set to [U63EuObeSwit6KvbAzBIRg] 1> [2022-01-15T09:37:37,796][INFO ][o.o.c.s.ClusterApplierService] [node_t0] master node changed {previous [], current [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true}]}, added {{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true}}, term: 1, version: 1, reason: ApplyCommitRequest{term=1, version=1, sourceNode={node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true}} 1> [2022-01-15T09:37:37,796][INFO ][o.o.n.Node ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#1]]] started 1> [2022-01-15T09:37:37,797][INFO ][o.o.c.s.ClusterApplierService] [node_t1] master node changed {previous [], current [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true}]}, added {{node_t0}{IdHo1pXgRVSr0AV5_fAddg}{D8mUTfrzTkq29lqQidfx_Q}{127.0.0.1}{127.0.0.1:38465}{dimr}{shard_indexing_pressure_enabled=true}}, term: 1, version: 1, reason: Publication{term=1, version=1} 1> [2022-01-15T09:37:37,798][INFO ][o.o.n.Node ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#2]]] started 1> [2022-01-15T09:37:37,801][INFO ][o.o.c.r.a.DiskThresholdMonitor] [node_t1] skipping monitor as a check is already in progress 1> [2022-01-15T09:37:37,862][INFO ][o.o.g.GatewayService ] [node_t1] recovered [0] indices into cluster_state 1> [2022-01-15T09:37:38,644][INFO ][o.o.c.s.MasterService ] [node_t1] node-join[{node_t2}{Isf3pfW-Q8e_iljeimAAUQ}{N45YWBpPRxG-IOkojR5LiA}{127.0.0.1}{127.0.0.1:39183}{shard_indexing_pressure_enabled=true} join existing leader], term: 1, version: 4, delta: added {{node_t2}{Isf3pfW-Q8e_iljeimAAUQ}{N45YWBpPRxG-IOkojR5LiA}{127.0.0.1}{127.0.0.1:39183}{shard_indexing_pressure_enabled=true}} 1> [2022-01-15T09:37:38,657][INFO ][o.o.c.s.ClusterApplierService] [node_t0] added {{node_t2}{Isf3pfW-Q8e_iljeimAAUQ}{N45YWBpPRxG-IOkojR5LiA}{127.0.0.1}{127.0.0.1:39183}{shard_indexing_pressure_enabled=true}}, term: 1, version: 4, reason: ApplyCommitRequest{term=1, version=4, sourceNode={node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true}} 1> [2022-01-15T09:37:38,657][INFO ][o.o.c.s.ClusterApplierService] [node_t2] master node changed {previous [], current [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true}]}, added {{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true},{node_t0}{IdHo1pXgRVSr0AV5_fAddg}{D8mUTfrzTkq29lqQidfx_Q}{127.0.0.1}{127.0.0.1:38465}{dimr}{shard_indexing_pressure_enabled=true}}, term: 1, version: 4, reason: ApplyCommitRequest{term=1, version=4, sourceNode={node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true}} 1> [2022-01-15T09:37:38,657][INFO ][o.o.n.Node ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#3]]] started 1> [2022-01-15T09:37:38,659][INFO ][o.o.c.s.ClusterApplierService] [node_t1] added {{node_t2}{Isf3pfW-Q8e_iljeimAAUQ}{N45YWBpPRxG-IOkojR5LiA}{127.0.0.1}{127.0.0.1:39183}{shard_indexing_pressure_enabled=true}}, term: 1, version: 4, reason: Publication{term=1, version=4} 1> [2022-01-15T09:37:38,681][INFO ][o.o.c.m.MetadataIndexTemplateService] [node_t1] adding template [random_index_template] for index patterns [*] 1> [2022-01-15T09:37:38,743][INFO ][o.o.i.ShardIndexingPressureSettingsIT] [testShardIndexingPressureEnforcedEnabledDisabledSetting] [ShardIndexingPressureSettingsIT#testShardIndexingPressureEnforcedEnabledDisabledSetting]: all set up test 1> [2022-01-15T09:37:38,746][INFO ][o.o.t.InternalTestCluster] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Stopping and resetting node [node_t0] 1> [2022-01-15T09:37:38,746][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] stopping ... 1> [2022-01-15T09:37:38,747][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] stopped 1> [2022-01-15T09:37:38,748][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] closing ... 1> [2022-01-15T09:37:38,747][INFO ][o.o.c.c.Coordinator ] [node_t0] master node [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true}] failed, restarting discovery 1> org.opensearch.transport.NodeDisconnectedException: [node_t1][127.0.0.1:42167][disconnected] disconnected 1> [2022-01-15T09:37:38,747][INFO ][o.o.c.c.FollowersChecker ] [node_t1] FollowerChecker{discoveryNode={node_t0}{IdHo1pXgRVSr0AV5_fAddg}{D8mUTfrzTkq29lqQidfx_Q}{127.0.0.1}{127.0.0.1:38465}{dimr}{shard_indexing_pressure_enabled=true}, failureCountSinceLastSuccess=0, [cluster.fault_detection.follower_check.retry_count]=3} disconnected 1> [2022-01-15T09:37:38,748][INFO ][o.o.c.c.FollowersChecker ] [node_t1] FollowerChecker{discoveryNode={node_t0}{IdHo1pXgRVSr0AV5_fAddg}{D8mUTfrzTkq29lqQidfx_Q}{127.0.0.1}{127.0.0.1:38465}{dimr}{shard_indexing_pressure_enabled=true}, failureCountSinceLastSuccess=0, [cluster.fault_detection.follower_check.retry_count]=3} marking node as faulty 1> [2022-01-15T09:37:38,749][INFO ][o.o.c.s.MasterService ] [node_t1] node-left[{node_t0}{IdHo1pXgRVSr0AV5_fAddg}{D8mUTfrzTkq29lqQidfx_Q}{127.0.0.1}{127.0.0.1:38465}{dimr}{shard_indexing_pressure_enabled=true} reason: disconnected], term: 1, version: 7, delta: removed {{node_t0}{IdHo1pXgRVSr0AV5_fAddg}{D8mUTfrzTkq29lqQidfx_Q}{127.0.0.1}{127.0.0.1:38465}{dimr}{shard_indexing_pressure_enabled=true}} 1> [2022-01-15T09:37:38,753][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] closed 1> [2022-01-15T09:37:38,753][INFO ][o.o.t.InternalTestCluster] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Stopping and resetting node [node_t1] 1> [2022-01-15T09:37:38,753][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] stopping ... 1> [2022-01-15T09:37:38,760][INFO ][o.o.c.s.ClusterApplierService] [node_t2] removed {{node_t0}{IdHo1pXgRVSr0AV5_fAddg}{D8mUTfrzTkq29lqQidfx_Q}{127.0.0.1}{127.0.0.1:38465}{dimr}{shard_indexing_pressure_enabled=true}}, term: 1, version: 7, reason: ApplyCommitRequest{term=1, version=7, sourceNode={node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true}} 1> [2022-01-15T09:37:38,761][INFO ][o.o.c.s.ClusterApplierService] [node_t1] removed {{node_t0}{IdHo1pXgRVSr0AV5_fAddg}{D8mUTfrzTkq29lqQidfx_Q}{127.0.0.1}{127.0.0.1:38465}{dimr}{shard_indexing_pressure_enabled=true}}, term: 1, version: 7, reason: Publication{term=1, version=7} 1> [2022-01-15T09:37:38,762][INFO ][o.o.c.c.FollowersChecker ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] FollowerChecker{discoveryNode={node_t2}{Isf3pfW-Q8e_iljeimAAUQ}{N45YWBpPRxG-IOkojR5LiA}{127.0.0.1}{127.0.0.1:39183}{shard_indexing_pressure_enabled=true}, failureCountSinceLastSuccess=0, [cluster.fault_detection.follower_check.retry_count]=3} disconnected 1> [2022-01-15T09:37:38,762][INFO ][o.o.c.c.FollowersChecker ] [node_t1] FollowerChecker{discoveryNode={node_t2}{Isf3pfW-Q8e_iljeimAAUQ}{N45YWBpPRxG-IOkojR5LiA}{127.0.0.1}{127.0.0.1:39183}{shard_indexing_pressure_enabled=true}, failureCountSinceLastSuccess=0, [cluster.fault_detection.follower_check.retry_count]=3} marking node as faulty 1> [2022-01-15T09:37:38,763][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] stopped 1> [2022-01-15T09:37:38,763][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] closing ... 1> [2022-01-15T09:37:38,763][INFO ][o.o.c.c.Coordinator ] [node_t2] master node [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true}] failed, restarting discovery 1> org.opensearch.transport.NodeDisconnectedException: [node_t1][127.0.0.1:42167][disconnected] disconnected 1> [2022-01-15T09:37:38,764][INFO ][o.o.c.s.ClusterApplierService] [node_t2] master node changed {previous [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true}], current []}, term: 1, version: 7, reason: becoming candidate: onLeaderFailure 1> [2022-01-15T09:37:38,765][WARN ][o.o.c.NodeConnectionsService] [node_t2] failed to connect to {node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{0sCnP479QVy05b6NHpFHRw}{127.0.0.1}{127.0.0.1:42167}{dimr}{shard_indexing_pressure_enabled=true} (tried [1] times) 1> org.opensearch.transport.ConnectTransportException: [node_t1][127.0.0.1:42167] connect_exception 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1064) ~[main/:?] 1> at org.opensearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:213) ~[main/:?] 1> at org.opensearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:55) ~[opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863) ~[?:?] 1> at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841) ~[?:?] 1> at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) ~[?:?] 1> at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2162) ~[?:?] 1> at org.opensearch.common.concurrent.CompletableContext.completeExceptionally(CompletableContext.java:70) ~[opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.SocketChannelContext.connect(SocketChannelContext.java:160) ~[opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.EventHandler.handleConnect(EventHandler.java:130) ~[opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.nio.TestEventHandler.handleConnect(TestEventHandler.java:139) ~[framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.attemptConnect(NioSelector.java:446) ~[opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.registerChannel(NioSelector.java:469) ~[opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.setUpNewChannels(NioSelector.java:458) ~[opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.preSelect(NioSelector.java:279) ~[opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:172) ~[opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) ~[opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> Caused by: java.net.ConnectException: Connection refused 1> at sun.nio.ch.Net.pollConnect(Native Method) ~[?:?] 1> at sun.nio.ch.Net.pollConnectNow(Net.java:672) ~[?:?] 1> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:946) ~[?:?] 1> at org.opensearch.nio.SocketChannelContext.connect(SocketChannelContext.java:157) ~[opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> ... 9 more 1> [2022-01-15T09:37:38,768][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] closed 1> [2022-01-15T09:37:38,768][INFO ][o.o.t.InternalTestCluster] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Stopping and resetting node [node_t2] 1> [2022-01-15T09:37:38,769][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] stopping ... 1> [2022-01-15T09:37:38,770][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] stopped 1> [2022-01-15T09:37:38,770][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] closing ... 1> [2022-01-15T09:37:38,771][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] closed 1> [2022-01-15T09:37:38,771][INFO ][o.o.t.InternalTestCluster] [testShardIndexingPressureEnforcedEnabledDisabledSetting] recreating node [node_t2] 1> [2022-01-15T09:37:38,773][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] version[2.0.0], pid[3888272], build[unknown/unknown/unknown], OS[Linux/5.11.0-1022-aws/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.1/17.0.1+12] 1> [2022-01-15T09:37:38,773][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] JVM home [/home/ubuntu/sw/jdk-17.0.1+12] 1> [2022-01-15T09:37:38,773][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] JVM arguments [-Dgradle.dist.lib=/home/ubuntu/.gradle/wrapper/dists/gradle-7.3.3-all/4295vidhdd9hd3gbjyw1xqxpo/gradle-7.3.3/lib, -Dgradle.user.home=/home/ubuntu/.gradle, -Dgradle.worker.jar=/home/ubuntu/.gradle/caches/7.3.3/workerMain/gradle-worker.jar, -Dio.netty.noKeySetOptimization=true, -Dio.netty.noUnsafe=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Djava.awt.headless=true, -Djava.locale.providers=SPI,COMPAT, -Djna.nosys=true, -Dopensearch.scripting.update.ctx_in_params=false, -Dopensearch.search.rewrite_sort=true, -Dopensearch.transport.cname_in_publish_address=true, -Dorg.gradle.internal.worker.tmpdir=/home/ubuntu/os/OpenSearch/server/build/tmp/internalClusterTest/work, -Dorg.gradle.native=false, -Dtests.artifact=server, -Dtests.gradle=true, -Dtests.jvm.argline=-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m, -Dtests.logger.level=WARN, -Dtests.security.manager=true, -Dtests.seed=589B15FA746087E9, -Dtests.task=:server:internalClusterTest, -XX:+HeapDumpOnOutOfMemoryError, -XX:ReservedCodeCacheSize=64m, -esa, --illegal-access=warn, -XX:HeapDumpPath=/home/ubuntu/os/OpenSearch/server/build/heapdump, -javaagent:../../tmp/expandedArchives/org.jacoco.agent-0.8.7.jar_3a83c50b4a016f281c4e9f3500d16b55/jacocoagent.jar=destfile=../../jacoco/internalClusterTest.exec,append=true,inclnolocationclasses=false,dumponexit=true,output=file,jmx=false, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, -Xms512m, -Xmx512m, -Dfile.encoding=UTF-8, -Djava.io.tmpdir=/home/ubuntu/os/OpenSearch/server/build/testrun/internalClusterTest/temp, -Duser.country, -Duser.language=en, -Duser.variant, -ea] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] no modules loaded 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.index.MockEngineFactoryPlugin] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.index.mapper.MockFieldFilterPlugin] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.node.NodeMocksPlugin] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.script.MockScriptService$TestPlugin] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.search.MockSearchService$TestPlugin] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.InternalSettingsPlugin] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.MockHttpTransport$TestPlugin] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.OpenSearchIntegTestCase$AssertActionNamePlugin] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.OpenSearchIntegTestCase$TestSeedPlugin] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.TestGeoShapeFieldMapperPlugin] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.store.MockFSIndexStore$TestPlugin] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.transport.MockTransportService$TestPlugin] 1> [2022-01-15T09:37:38,774][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.transport.nio.MockNioTransportPlugin] 1> [2022-01-15T09:37:38,776][INFO ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using [1] data paths, mounts [[/ (/dev/root)]], net usable_space [93.4gb], net total_space [116.2gb], types [ext4] 1> [2022-01-15T09:37:38,776][INFO ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] heap size [512mb], compressed ordinary object pointers [true] 1> [2022-01-15T09:37:38,786][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] node name [node_t2], node ID [Isf3pfW-Q8e_iljeimAAUQ], cluster name [TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster], roles [] 1> [2022-01-15T09:37:38,799][INFO ][o.o.d.DiscoveryModule ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using discovery type [zen] and seed hosts providers [settings, file] 1> [2022-01-15T09:37:38,808][WARN ][o.o.g.DanglingIndicesState] [testShardIndexingPressureEnforcedEnabledDisabledSetting] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually 1> [2022-01-15T09:37:38,815][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] initialized 1> [2022-01-15T09:37:38,816][INFO ][o.o.t.InternalTestCluster] [testShardIndexingPressureEnforcedEnabledDisabledSetting] recreating node [node_t0] 1> [2022-01-15T09:37:38,817][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] version[2.0.0], pid[3888272], build[unknown/unknown/unknown], OS[Linux/5.11.0-1022-aws/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.1/17.0.1+12] 1> [2022-01-15T09:37:38,817][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] JVM home [/home/ubuntu/sw/jdk-17.0.1+12] 1> [2022-01-15T09:37:38,817][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] JVM arguments [-Dgradle.dist.lib=/home/ubuntu/.gradle/wrapper/dists/gradle-7.3.3-all/4295vidhdd9hd3gbjyw1xqxpo/gradle-7.3.3/lib, -Dgradle.user.home=/home/ubuntu/.gradle, -Dgradle.worker.jar=/home/ubuntu/.gradle/caches/7.3.3/workerMain/gradle-worker.jar, -Dio.netty.noKeySetOptimization=true, -Dio.netty.noUnsafe=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Djava.awt.headless=true, -Djava.locale.providers=SPI,COMPAT, -Djna.nosys=true, -Dopensearch.scripting.update.ctx_in_params=false, -Dopensearch.search.rewrite_sort=true, -Dopensearch.transport.cname_in_publish_address=true, -Dorg.gradle.internal.worker.tmpdir=/home/ubuntu/os/OpenSearch/server/build/tmp/internalClusterTest/work, -Dorg.gradle.native=false, -Dtests.artifact=server, -Dtests.gradle=true, -Dtests.jvm.argline=-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m, -Dtests.logger.level=WARN, -Dtests.security.manager=true, -Dtests.seed=589B15FA746087E9, -Dtests.task=:server:internalClusterTest, -XX:+HeapDumpOnOutOfMemoryError, -XX:ReservedCodeCacheSize=64m, -esa, --illegal-access=warn, -XX:HeapDumpPath=/home/ubuntu/os/OpenSearch/server/build/heapdump, -javaagent:../../tmp/expandedArchives/org.jacoco.agent-0.8.7.jar_3a83c50b4a016f281c4e9f3500d16b55/jacocoagent.jar=destfile=../../jacoco/internalClusterTest.exec,append=true,inclnolocationclasses=false,dumponexit=true,output=file,jmx=false, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, -Xms512m, -Xmx512m, -Dfile.encoding=UTF-8, -Djava.io.tmpdir=/home/ubuntu/os/OpenSearch/server/build/testrun/internalClusterTest/temp, -Duser.country, -Duser.language=en, -Duser.variant, -ea] 1> [2022-01-15T09:37:38,817][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] no modules loaded 1> [2022-01-15T09:37:38,817][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.index.MockEngineFactoryPlugin] 1> [2022-01-15T09:37:38,817][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.index.mapper.MockFieldFilterPlugin] 1> [2022-01-15T09:37:38,817][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.node.NodeMocksPlugin] 1> [2022-01-15T09:37:38,817][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.script.MockScriptService$TestPlugin] 1> [2022-01-15T09:37:38,817][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.search.MockSearchService$TestPlugin] 1> [2022-01-15T09:37:38,818][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.InternalSettingsPlugin] 1> [2022-01-15T09:37:38,818][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.MockHttpTransport$TestPlugin] 1> [2022-01-15T09:37:38,818][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.OpenSearchIntegTestCase$AssertActionNamePlugin] 1> [2022-01-15T09:37:38,818][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.OpenSearchIntegTestCase$TestSeedPlugin] 1> [2022-01-15T09:37:38,818][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.TestGeoShapeFieldMapperPlugin] 1> [2022-01-15T09:37:38,818][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.store.MockFSIndexStore$TestPlugin] 1> [2022-01-15T09:37:38,818][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.transport.MockTransportService$TestPlugin] 1> [2022-01-15T09:37:38,818][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.transport.nio.MockNioTransportPlugin] 1> [2022-01-15T09:37:38,820][INFO ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using [1] data paths, mounts [[/ (/dev/root)]], net usable_space [93.4gb], net total_space [116.2gb], types [ext4] 1> [2022-01-15T09:37:38,820][INFO ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] heap size [512mb], compressed ordinary object pointers [true] 1> [2022-01-15T09:37:38,830][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] node name [node_t0], node ID [IdHo1pXgRVSr0AV5_fAddg], cluster name [TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster], roles [master, remote_cluster_client, data, ingest] 1> [2022-01-15T09:37:38,849][INFO ][o.o.d.DiscoveryModule ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using discovery type [zen] and seed hosts providers [settings, file] 1> [2022-01-15T09:37:38,856][WARN ][o.o.g.DanglingIndicesState] [testShardIndexingPressureEnforcedEnabledDisabledSetting] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually 1> [2022-01-15T09:37:38,862][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] initialized 1> [2022-01-15T09:37:38,862][INFO ][o.o.t.InternalTestCluster] [testShardIndexingPressureEnforcedEnabledDisabledSetting] recreating node [node_t1] 1> [2022-01-15T09:37:38,863][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] version[2.0.0], pid[3888272], build[unknown/unknown/unknown], OS[Linux/5.11.0-1022-aws/amd64], JVM[Eclipse Adoptium/OpenJDK 64-Bit Server VM/17.0.1/17.0.1+12] 1> [2022-01-15T09:37:38,863][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] JVM home [/home/ubuntu/sw/jdk-17.0.1+12] 1> [2022-01-15T09:37:38,863][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] JVM arguments [-Dgradle.dist.lib=/home/ubuntu/.gradle/wrapper/dists/gradle-7.3.3-all/4295vidhdd9hd3gbjyw1xqxpo/gradle-7.3.3/lib, -Dgradle.user.home=/home/ubuntu/.gradle, -Dgradle.worker.jar=/home/ubuntu/.gradle/caches/7.3.3/workerMain/gradle-worker.jar, -Dio.netty.noKeySetOptimization=true, -Dio.netty.noUnsafe=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Djava.awt.headless=true, -Djava.locale.providers=SPI,COMPAT, -Djna.nosys=true, -Dopensearch.scripting.update.ctx_in_params=false, -Dopensearch.search.rewrite_sort=true, -Dopensearch.transport.cname_in_publish_address=true, -Dorg.gradle.internal.worker.tmpdir=/home/ubuntu/os/OpenSearch/server/build/tmp/internalClusterTest/work, -Dorg.gradle.native=false, -Dtests.artifact=server, -Dtests.gradle=true, -Dtests.jvm.argline=-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m, -Dtests.logger.level=WARN, -Dtests.security.manager=true, -Dtests.seed=589B15FA746087E9, -Dtests.task=:server:internalClusterTest, -XX:+HeapDumpOnOutOfMemoryError, -XX:ReservedCodeCacheSize=64m, -esa, --illegal-access=warn, -XX:HeapDumpPath=/home/ubuntu/os/OpenSearch/server/build/heapdump, -javaagent:../../tmp/expandedArchives/org.jacoco.agent-0.8.7.jar_3a83c50b4a016f281c4e9f3500d16b55/jacocoagent.jar=destfile=../../jacoco/internalClusterTest.exec,append=true,inclnolocationclasses=false,dumponexit=true,output=file,jmx=false, --add-opens=java.base/java.util=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, -Xms512m, -Xmx512m, -Dfile.encoding=UTF-8, -Djava.io.tmpdir=/home/ubuntu/os/OpenSearch/server/build/testrun/internalClusterTest/temp, -Duser.country, -Duser.language=en, -Duser.variant, -ea] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] no modules loaded 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.index.MockEngineFactoryPlugin] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.index.mapper.MockFieldFilterPlugin] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.node.NodeMocksPlugin] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.script.MockScriptService$TestPlugin] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.search.MockSearchService$TestPlugin] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.InternalSettingsPlugin] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.MockHttpTransport$TestPlugin] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.OpenSearchIntegTestCase$AssertActionNamePlugin] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.OpenSearchIntegTestCase$TestSeedPlugin] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.TestGeoShapeFieldMapperPlugin] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.store.MockFSIndexStore$TestPlugin] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.test.transport.MockTransportService$TestPlugin] 1> [2022-01-15T09:37:38,864][INFO ][o.o.p.PluginsService ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] loaded plugin [org.opensearch.transport.nio.MockNioTransportPlugin] 1> [2022-01-15T09:37:38,866][INFO ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using [1] data paths, mounts [[/ (/dev/root)]], net usable_space [93.4gb], net total_space [116.2gb], types [ext4] 1> [2022-01-15T09:37:38,866][INFO ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] heap size [512mb], compressed ordinary object pointers [true] 1> [2022-01-15T09:37:38,883][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] node name [node_t1], node ID [UnDoZ4G8SQOOwTd1w6R1dg], cluster name [TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster], roles [master, remote_cluster_client, data, ingest] 1> [2022-01-15T09:37:38,899][INFO ][o.o.d.DiscoveryModule ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using discovery type [zen] and seed hosts providers [settings, file] 1> [2022-01-15T09:37:38,907][WARN ][o.o.g.DanglingIndicesState] [testShardIndexingPressureEnforcedEnabledDisabledSetting] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually 1> [2022-01-15T09:37:38,913][INFO ][o.o.n.Node ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] initialized 1> [2022-01-15T09:37:38,921][INFO ][o.o.n.Node ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#6]]] starting ... 1> [2022-01-15T09:37:38,921][INFO ][o.o.n.Node ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#5]]] starting ... 1> [2022-01-15T09:37:38,921][INFO ][o.o.n.Node ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#4]]] starting ... 1> [2022-01-15T09:37:38,925][INFO ][o.o.t.TransportService ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#6]]] publish_address {127.0.0.1:45001}, bound_addresses {[::1]:45515}, {127.0.0.1:45001} 1> [2022-01-15T09:37:38,925][INFO ][o.o.t.TransportService ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#4]]] publish_address {127.0.0.1:40645}, bound_addresses {[::1]:42199}, {127.0.0.1:40645} 1> [2022-01-15T09:37:38,925][INFO ][o.o.t.TransportService ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#5]]] publish_address {127.0.0.1:42923}, bound_addresses {[::1]:44549}, {127.0.0.1:42923} 1> [2022-01-15T09:37:38,994][INFO ][o.o.c.c.Coordinator ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#5]]] cluster UUID [U63EuObeSwit6KvbAzBIRg] 1> [2022-01-15T09:37:38,999][WARN ][o.o.t.TcpTransport ] [node_t1] exception caught on transport layer [NioSocketChannel{localAddress=/127.0.0.1:45001, remoteAddress=/127.0.0.1:60314}], closing connection 1> java.lang.IllegalStateException: transport not ready yet to handle incoming requests 1> at org.opensearch.transport.TransportService.onRequestReceived(TransportService.java:1103) ~[main/:?] 1> at org.opensearch.transport.InboundHandler.handleRequest(InboundHandler.java:195) ~[main/:?] 1> at org.opensearch.transport.InboundHandler.messageReceived(InboundHandler.java:126) ~[main/:?] 1> at org.opensearch.transport.InboundHandler.inboundMessage(InboundHandler.java:108) ~[main/:?] 1> at org.opensearch.transport.TcpTransport.inboundMessage(TcpTransport.java:759) [main/:?] 1> at org.opensearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:170) [main/:?] 1> at org.opensearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:145) [main/:?] 1> at org.opensearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:110) [main/:?] 1> at org.opensearch.transport.nio.MockNioTransport$MockTcpReadWriteHandler.consumeReads(MockNioTransport.java:341) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.SocketChannelContext.handleReadBytes(SocketChannelContext.java:246) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.BytesChannelContext.read(BytesChannelContext.java:59) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.EventHandler.handleRead(EventHandler.java:152) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.nio.TestEventHandler.handleRead(TestEventHandler.java:167) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.handleRead(NioSelector.java:438) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.processKey(NioSelector.java:264) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:191) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T09:37:38,999][WARN ][o.o.t.TcpTransport ] [node_t1] exception caught on transport layer [NioSocketChannel{localAddress=/127.0.0.1:45001, remoteAddress=/127.0.0.1:60310}], closing connection 1> java.lang.IllegalStateException: transport not ready yet to handle incoming requests 1> at org.opensearch.transport.TransportService.onRequestReceived(TransportService.java:1103) ~[main/:?] 1> at org.opensearch.transport.InboundHandler.handleRequest(InboundHandler.java:195) ~[main/:?] 1> at org.opensearch.transport.InboundHandler.messageReceived(InboundHandler.java:126) ~[main/:?] 1> at org.opensearch.transport.InboundHandler.inboundMessage(InboundHandler.java:108) ~[main/:?] 1> at org.opensearch.transport.TcpTransport.inboundMessage(TcpTransport.java:759) [main/:?] 1> at org.opensearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:170) [main/:?] 1> at org.opensearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:145) [main/:?] 1> at org.opensearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:110) [main/:?] 1> at org.opensearch.transport.nio.MockNioTransport$MockTcpReadWriteHandler.consumeReads(MockNioTransport.java:341) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.SocketChannelContext.handleReadBytes(SocketChannelContext.java:246) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.BytesChannelContext.read(BytesChannelContext.java:59) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.EventHandler.handleRead(EventHandler.java:152) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.nio.TestEventHandler.handleRead(TestEventHandler.java:167) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.handleRead(NioSelector.java:438) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.processKey(NioSelector.java:264) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:191) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T09:37:39,003][INFO ][o.o.c.c.Coordinator ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#6]]] cluster UUID [U63EuObeSwit6KvbAzBIRg] 1> [2022-01-15T09:37:39,083][INFO ][o.o.c.s.MasterService ] [node_t1] elected-as-master ([1] nodes joined)[{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 2, version: 8, delta: master node changed {previous [], current [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}]} 1> [2022-01-15T09:37:39,110][INFO ][o.o.c.s.ClusterApplierService] [node_t1] master node changed {previous [], current [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}]}, term: 2, version: 8, reason: Publication{term=2, version=8} 1> [2022-01-15T09:37:39,112][INFO ][o.o.n.Node ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#6]]] started 1> [2022-01-15T09:37:39,112][INFO ][o.o.c.s.MasterService ] [node_t1] node-join[{node_t0}{IdHo1pXgRVSr0AV5_fAddg}{KjdwLNVBRBSzOwP_5hSLyA}{127.0.0.1}{127.0.0.1:42923}{dimr}{shard_indexing_pressure_enabled=true} join existing leader], term: 2, version: 9, delta: added {{node_t0}{IdHo1pXgRVSr0AV5_fAddg}{KjdwLNVBRBSzOwP_5hSLyA}{127.0.0.1}{127.0.0.1:42923}{dimr}{shard_indexing_pressure_enabled=true}} 1> [2022-01-15T09:37:39,153][INFO ][o.o.c.s.ClusterApplierService] [node_t0] master node changed {previous [], current [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}]}, added {{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}}, term: 2, version: 9, reason: ApplyCommitRequest{term=2, version=9, sourceNode={node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}} 1> [2022-01-15T09:37:39,154][INFO ][o.o.n.Node ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#5]]] started 1> [2022-01-15T09:37:39,154][INFO ][o.o.c.s.ClusterApplierService] [node_t1] added {{node_t0}{IdHo1pXgRVSr0AV5_fAddg}{KjdwLNVBRBSzOwP_5hSLyA}{127.0.0.1}{127.0.0.1:42923}{dimr}{shard_indexing_pressure_enabled=true}}, term: 2, version: 9, reason: Publication{term=2, version=9} 1> [2022-01-15T09:37:39,166][INFO ][o.o.g.GatewayService ] [node_t1] recovered [0] indices into cluster_state 1> [2022-01-15T09:37:40,005][INFO ][o.o.c.s.MasterService ] [node_t1] node-join[{node_t2}{Isf3pfW-Q8e_iljeimAAUQ}{vRNxKfKhQC2W4quo7pruQA}{127.0.0.1}{127.0.0.1:40645}{shard_indexing_pressure_enabled=true} join existing leader], term: 2, version: 11, delta: added {{node_t2}{Isf3pfW-Q8e_iljeimAAUQ}{vRNxKfKhQC2W4quo7pruQA}{127.0.0.1}{127.0.0.1:40645}{shard_indexing_pressure_enabled=true}} 1> [2022-01-15T09:37:40,019][INFO ][o.o.c.s.ClusterApplierService] [node_t0] added {{node_t2}{Isf3pfW-Q8e_iljeimAAUQ}{vRNxKfKhQC2W4quo7pruQA}{127.0.0.1}{127.0.0.1:40645}{shard_indexing_pressure_enabled=true}}, term: 2, version: 11, reason: ApplyCommitRequest{term=2, version=11, sourceNode={node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}} 1> [2022-01-15T09:37:40,019][INFO ][o.o.c.s.ClusterApplierService] [node_t2] master node changed {previous [], current [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}]}, added {{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true},{node_t0}{IdHo1pXgRVSr0AV5_fAddg}{KjdwLNVBRBSzOwP_5hSLyA}{127.0.0.1}{127.0.0.1:42923}{dimr}{shard_indexing_pressure_enabled=true}}, term: 2, version: 11, reason: ApplyCommitRequest{term=2, version=11, sourceNode={node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}} 1> [2022-01-15T09:37:40,020][INFO ][o.o.n.Node ] [[test_TEST-TEST_WORKER_VM=[17969]-CLUSTER_SEED=[-3296594735595978642]-HASH=[357E49F5ADEB3]-cluster[T#4]]] started 1> [2022-01-15T09:37:40,022][INFO ][o.o.c.s.ClusterApplierService] [node_t1] added {{node_t2}{Isf3pfW-Q8e_iljeimAAUQ}{vRNxKfKhQC2W4quo7pruQA}{127.0.0.1}{127.0.0.1:40645}{shard_indexing_pressure_enabled=true}}, term: 2, version: 11, reason: Publication{term=2, version=11} 1> [2022-01-15T09:37:40,024][INFO ][o.o.i.ShardIndexingPressureSettingsIT] [testShardIndexingPressureEnforcedEnabledDisabledSetting] using custom data_path for index: [CNfkJAPBbe] 1> [2022-01-15T09:37:40,027][INFO ][o.o.c.m.MetadataCreateIndexService] [node_t1] [test_index] creating index, cause [api], templates [random_index_template], shards [1]/[1] 1> [2022-01-15T09:37:40,493][INFO ][o.o.c.r.a.AllocationService] [node_t1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[test_index][0]]]). 1> [2022-01-15T09:37:40,565][INFO ][o.o.i.ShardIndexingPressureSettingsIT] [testShardIndexingPressureEnforcedEnabledDisabledSetting] primaryName ===> node_t1 1> [2022-01-15T09:37:40,565][INFO ][o.o.i.ShardIndexingPressureSettingsIT] [testShardIndexingPressureEnforcedEnabledDisabledSetting] coordinatingOnlyNode ===> node_t2 1> [2022-01-15T09:37:40,569][INFO ][o.o.a.b.TransportBulkAction] [testShardIndexingPressureEnforcedEnabledDisabledSetting] isShardIndexingPressureEnabled() ==> true 1> [2022-01-15T09:37:40,570][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Soft limit not breached 1> [2022-01-15T09:37:40,571][INFO ][o.o.i.ShardIndexingPressure] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeLevelLimitBreached => false , shardLevelLimitBreached ==> false 1> [2022-01-15T09:37:40,575][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t1] Soft limit not breached 1> [2022-01-15T09:37:40,585][INFO ][o.o.c.m.MetadataMappingService] [node_t1] [test_index/U-e3lfKXQeS14FVqxiFeTA] create_mapping [_doc] 1> [2022-01-15T09:37:40,689][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t0] Soft limit not breached 1> [2022-01-15T09:37:40,754][INFO ][o.o.i.ShardIndexingPressureSettingsIT] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Sending bulk requests ==> 1> [2022-01-15T09:37:40,757][INFO ][o.o.a.b.TransportBulkAction] [testShardIndexingPressureEnforcedEnabledDisabledSetting] isShardIndexingPressureEnabled() ==> true 1> [2022-01-15T09:37:40,757][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Soft limit not breached 1> [2022-01-15T09:37:40,757][INFO ][o.o.i.ShardIndexingPressure] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeLevelLimitBreached => false , shardLevelLimitBreached ==> false 1> [2022-01-15T09:37:40,759][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t1] Soft limit not breached 1> [2022-01-15T09:37:40,759][INFO ][o.o.a.b.TransportBulkAction] [testShardIndexingPressureEnforcedEnabledDisabledSetting] isShardIndexingPressureEnabled() ==> true 1> [2022-01-15T09:37:40,759][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Soft limit not breached 1> [2022-01-15T09:37:40,759][INFO ][o.o.i.ShardIndexingPressure] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeLevelLimitBreached => false , shardLevelLimitBreached ==> false 1> [2022-01-15T09:37:40,760][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t1] Soft limit not breached 1> [2022-01-15T09:37:40,786][INFO ][o.o.a.b.TransportBulkAction] [testShardIndexingPressureEnforcedEnabledDisabledSetting] isShardIndexingPressureEnabled() ==> true 1> [2022-01-15T09:37:40,786][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Soft limit breached 1> [2022-01-15T09:37:40,786][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeTotalBytes ==> 68568, nodeLimit ==> 86852 1> [2022-01-15T09:37:40,787][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] shardLastSuccessfulRequestDurationLimitsBreached ============== 1> [2022-01-15T09:37:40,787][INFO ][o.o.i.ShardIndexingPressure] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeLevelLimitBreached => false , shardLevelLimitBreached ==> true 1> [2022-01-15T09:37:40,798][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t0] Soft limit not breached 1> [2022-01-15T09:37:40,838][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t0] Soft limit not breached 1> [2022-01-15T09:37:41,085][INFO ][o.o.c.s.ClusterSettings ] [node_t2] updating [shard_indexing_pressure.enforced] from [true] to [false] 1> [2022-01-15T09:37:41,093][INFO ][o.o.c.s.ClusterSettings ] [node_t0] updating [shard_indexing_pressure.enforced] from [true] to [false] 1> [2022-01-15T09:37:41,096][INFO ][o.o.c.s.ClusterSettings ] [node_t1] updating [shard_indexing_pressure.enforced] from [true] to [false] 1> [2022-01-15T09:37:41,101][INFO ][o.o.a.b.TransportBulkAction] [testShardIndexingPressureEnforcedEnabledDisabledSetting] isShardIndexingPressureEnabled() ==> true 1> [2022-01-15T09:37:41,101][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Soft limit not breached 1> [2022-01-15T09:37:41,101][INFO ][o.o.i.ShardIndexingPressure] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeLevelLimitBreached => false , shardLevelLimitBreached ==> false 1> [2022-01-15T09:37:41,103][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t1] Soft limit not breached 1> [2022-01-15T09:37:41,141][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t0] Soft limit not breached 1> [2022-01-15T09:37:41,177][INFO ][o.o.i.ShardIndexingPressureSettingsIT] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Sending bulk requests post disabling shard indexing pressure 1> [2022-01-15T09:37:41,179][INFO ][o.o.a.b.TransportBulkAction] [testShardIndexingPressureEnforcedEnabledDisabledSetting] isShardIndexingPressureEnabled() ==> true 1> [2022-01-15T09:37:41,179][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Soft limit not breached 1> [2022-01-15T09:37:41,179][INFO ][o.o.i.ShardIndexingPressure] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeLevelLimitBreached => false , shardLevelLimitBreached ==> false 1> [2022-01-15T09:37:41,181][INFO ][o.o.a.b.TransportBulkAction] [testShardIndexingPressureEnforcedEnabledDisabledSetting] isShardIndexingPressureEnabled() ==> true 1> [2022-01-15T09:37:41,181][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t1] Soft limit not breached 1> [2022-01-15T09:37:41,181][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Soft limit not breached 1> [2022-01-15T09:37:41,181][INFO ][o.o.i.ShardIndexingPressure] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeLevelLimitBreached => false , shardLevelLimitBreached ==> false 1> [2022-01-15T09:37:41,182][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t1] Soft limit not breached 1> [2022-01-15T09:37:41,208][INFO ][o.o.a.b.TransportBulkAction] [testShardIndexingPressureEnforcedEnabledDisabledSetting] isShardIndexingPressureEnabled() ==> true 1> [2022-01-15T09:37:41,208][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Soft limit breached 1> [2022-01-15T09:37:41,208][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeTotalBytes ==> 68568, nodeLimit ==> 86852 1> [2022-01-15T09:37:41,208][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] shardLastSuccessfulRequestDurationLimitsBreached ============== 1> [2022-01-15T09:37:41,208][INFO ][o.o.i.ShardIndexingPressure] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeLevelLimitBreached => false , shardLevelLimitBreached ==> true 1> [2022-01-15T09:37:41,210][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t1] Soft limit breached 1> [2022-01-15T09:37:41,210][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t1] nodeTotalBytes ==> 68568, nodeLimit ==> 86852 1> [2022-01-15T09:37:41,210][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t1] shardLastSuccessfulRequestDurationLimitsBreached ============== 1> [2022-01-15T09:37:41,212][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t0] Soft limit not breached 1> [2022-01-15T09:37:41,247][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t0] Soft limit not breached 1> [2022-01-15T09:37:41,284][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t0] Soft limit not breached 1> [2022-01-15T09:37:41,354][INFO ][o.o.c.s.ClusterSettings ] [node_t2] updating [shard_indexing_pressure.enforced] from [false] to [true] 1> [2022-01-15T09:37:41,354][INFO ][o.o.c.s.ClusterSettings ] [node_t0] updating [shard_indexing_pressure.enforced] from [false] to [true] 1> [2022-01-15T09:37:41,355][INFO ][o.o.c.s.ClusterSettings ] [node_t1] updating [shard_indexing_pressure.enforced] from [false] to [true] 1> [2022-01-15T09:37:41,358][INFO ][o.o.a.b.TransportBulkAction] [testShardIndexingPressureEnforcedEnabledDisabledSetting] isShardIndexingPressureEnabled() ==> true 1> [2022-01-15T09:37:41,358][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Soft limit not breached 1> [2022-01-15T09:37:41,358][INFO ][o.o.i.ShardIndexingPressure] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeLevelLimitBreached => false , shardLevelLimitBreached ==> false 1> [2022-01-15T09:37:41,360][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t1] Soft limit not breached 1> [2022-01-15T09:37:41,385][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t0] Soft limit not breached 1> [2022-01-15T09:37:41,606][INFO ][o.o.i.ShardIndexingPressureSettingsIT] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Sending bulk requests post re-enabling shard indexing pressure 1> [2022-01-15T09:37:41,607][INFO ][o.o.a.b.TransportBulkAction] [testShardIndexingPressureEnforcedEnabledDisabledSetting] isShardIndexingPressureEnabled() ==> true 1> [2022-01-15T09:37:41,608][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Soft limit not breached 1> [2022-01-15T09:37:41,608][INFO ][o.o.i.ShardIndexingPressure] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeLevelLimitBreached => false , shardLevelLimitBreached ==> false 1> [2022-01-15T09:37:41,610][INFO ][o.o.a.b.TransportBulkAction] [testShardIndexingPressureEnforcedEnabledDisabledSetting] isShardIndexingPressureEnabled() ==> true 1> [2022-01-15T09:37:41,610][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Soft limit not breached 1> [2022-01-15T09:37:41,610][INFO ][o.o.i.ShardIndexingPressure] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeLevelLimitBreached => false , shardLevelLimitBreached ==> false 1> [2022-01-15T09:37:41,614][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t1] Soft limit not breached 1> [2022-01-15T09:37:41,614][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [node_t1] Soft limit not breached 1> [2022-01-15T09:37:41,639][INFO ][o.o.a.b.TransportBulkAction] [testShardIndexingPressureEnforcedEnabledDisabledSetting] isShardIndexingPressureEnabled() ==> true 1> [2022-01-15T09:37:41,639][INFO ][o.o.i.ShardIndexingPressureMemoryManager] [testShardIndexingPressureEnforcedEnabledDisabledSetting] Soft limit not breached 1> [2022-01-15T09:37:41,639][INFO ][o.o.i.ShardIndexingPressure] [testShardIndexingPressureEnforcedEnabledDisabledSetting] nodeLevelLimitBreached => false , shardLevelLimitBreached ==> false 2> 1月 15, 2022 9:47:37 上午 com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate 2> 警告: Suite execution timed out: org.opensearch.index.ShardIndexingPressureSettingsIT 2> ==== jstack at approximately timeout time ==== 2> "Test worker" ID=1 WAITING on com.carrotsearch.randomizedtesting.RandomizedRunner$2@c76b7ed 2> at java.base@17.0.1/java.lang.Object.wait(Native Method) 2> - waiting on com.carrotsearch.randomizedtesting.RandomizedRunner$2@c76b7ed 2> at java.base@17.0.1/java.lang.Thread.join(Thread.java:1304) 2> at java.base@17.0.1/java.lang.Thread.join(Thread.java:1372) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:639) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:496) 2> at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:110) 2> at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:58) 2> at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:38) 2> at org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:62) 2> at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51) 2> at java.base@17.0.1/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2> at java.base@17.0.1/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) 2> at java.base@17.0.1/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2> at java.base@17.0.1/java.lang.reflect.Method.invoke(Method.java:568) 2> at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36) 2> at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24) 2> at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33) 2> at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94) 2> at jdk.proxy2/jdk.proxy2.$Proxy5.processTestClass(Unknown Source) 2> at org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:176) 2> at org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:129) 2> at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:100) 2> at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:60) 2> at org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56) 2> at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:133) 2> at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:71) 2> at app//worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69) 2> at app//worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74) 2> "Reference Handler" ID=2 RUNNABLE 2> at java.base@17.0.1/java.lang.ref.Reference.waitForReferencePendingList(Native Method) 2> at java.base@17.0.1/java.lang.ref.Reference.processPendingReferences(Reference.java:253) 2> at java.base@17.0.1/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:215) 2> "Finalizer" ID=3 WAITING on java.lang.ref.ReferenceQueue$Lock@7c4cd420 2> at java.base@17.0.1/java.lang.Object.wait(Native Method) 2> - waiting on java.lang.ref.ReferenceQueue$Lock@7c4cd420 2> at java.base@17.0.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155) 2> at java.base@17.0.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176) 2> at java.base@17.0.1/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:172) 2> "Signal Dispatcher" ID=4 RUNNABLE 2> "Common-Cleaner" ID=26 TIMED_WAITING on java.lang.ref.ReferenceQueue$Lock@3dd1fdf8 2> at java.base@17.0.1/java.lang.Object.wait(Native Method) 2> - timed waiting on java.lang.ref.ReferenceQueue$Lock@3dd1fdf8 2> at java.base@17.0.1/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155) 2> at java.base@17.0.1/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:140) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> at java.base@17.0.1/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:162) 2> "Notification Thread" ID=28 RUNNABLE 2> "/127.0.0.1:51236 to /127.0.0.1:38295 workers" ID=30 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@14d964c3 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@14d964c3 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:370) 2> at org.gradle.api.internal.tasks.testing.worker.TestWorker.submitToRun(TestWorker.java:207) 2> - locked org.gradle.api.internal.tasks.testing.worker.TestWorker@2d644299 2> at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:169) 2> at java.base@17.0.1/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2> at java.base@17.0.1/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) 2> at java.base@17.0.1/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2> at java.base@17.0.1/java.lang.reflect.Method.invoke(Method.java:568) 2> at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36) 2> at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24) 2> at org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:182) 2> at org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:164) 2> at org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:414) 2> at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) 2> at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:61) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> Locked synchronizers: 2> - java.util.concurrent.ThreadPoolExecutor$Worker@24c22fe 2> "/127.0.0.1:51236 to /127.0.0.1:38295 workers Thread 2" ID=31 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@26d5759d 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@26d5759d 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at org.gradle.internal.remote.internal.hub.queue.EndPointQueue.take(EndPointQueue.java:4 2> 9) 2> at org.gradle.internal.remote.internal.hub.MessageHub$ConnectionDispatch.run(MessageHub.java:322) 2> at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) 2> at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:61) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> Locked synchronizers: 2> - java.util.concurrent.ThreadPoolExecutor$Worker@5170bcf4 2> "/127.0.0.1:51236 to /127.0.0.1:38295 workers Thread 3" ID=32 RUNNABLE (in native code) 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> - locked sun.nio.ch.Util$2@292a9b54 2> - locked sun.nio.ch.EPollSelectorImpl@551f9bdf 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:146) 2> at org.gradle.internal.remote.internal.inet.SocketConnection$SocketInputStream.read(SocketConnection.java:185) 2> at com.esotericsoftware.kryo.io.Input.fill(Input.java:146) 2> at com.esotericsoftware.kryo.io.Input.require(Input.java:178) 2> at com.esotericsoftware.kryo.io.Input.readByte(Input.java:295) 2> at org.gradle.internal.serialize.kryo.KryoBackedDecoder.readByte(KryoBackedDecoder.java:82) 2> at org.gradle.internal.remote.internal.hub.InterHubMessageSerializer$MessageReader.read(InterHubMessageSerializer.java:64) 2> at org.gradle.internal.remote.internal.hub.InterHubMessageSerializer$MessageReader.read(InterHubMessageSerializer.java:52) 2> at org.gradle.internal.remote.internal.inet.SocketConnection.receive(SocketConnection.java:81) 2> at org.gradle.internal.remote.internal.hub.MessageHub$ConnectionReceive.run(MessageHub.java:270) 2> at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64) 2> at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:48) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:61) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> Locked synchronizers: 2> - java.util.concurrent.ThreadPoolExecutor$Worker@f99f5e0 2> "SUITE-ShardIndexingPressureSettingsIT-seed#[589B15FA746087E9]" ID=281 RUNNABLE 2> at java.management@17.0.1/sun.management.ThreadImpl.dumpThreads0(Native Method) 2> at java.management@17.0.1/sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:521) 2> at java.management@17.0.1/sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:509) 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:681) 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:65) 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415) 2> - locked java.lang.Object@abf12c3 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:708) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:138) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:629) 2> "TEST-ShardIndexingPressureSettingsIT.testShardIndexingPressureEnforcedEnabledDisabledSetting-seed#[589B15FA746087E9]" ID=282 WAITING on org.opensearch.common.util.concurrent.BaseFuture$Sync@7cbf794 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.BaseFuture$Sync@7cbf794 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:211) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:715) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1047) 2> at app//org.opensearch.common.util.concurrent.BaseFuture$Sync.get(BaseFuture.java:267) 2> at app//org.opensearch.common.util.concurrent.BaseFuture.get(BaseFuture.java:99) 2> at app//org.opensearch.common.util.concurrent.FutureUtils.get(FutureUtils.java:69) 2> at app//org.opensearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:50) 2> at app//org.opensearch.index.ShardIndexingPressureSettingsIT.lambda$testShardIndexingPressureEnforcedEnabledDisabledSetting$2(ShardIndexingPressureSettingsIT.java:425) 2> at app//org.opensearch.index.ShardIndexingPressureSettingsIT$$Lambda$4106/0x00000008015372b0.run(Unknown Source) 2> at app//org.apache.lucene.util.LuceneTestCase._expectThrows(LuceneTestCase.java:2879) 2> at app//org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2754) 2> at app//org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2749) 2> at app//org.opensearch.index.ShardIndexingPressureSettingsIT.testShardIndexingPressureEnforcedEnabledDisabledSetting(ShardIndexingPressureSettingsIT.java:425) 2> at java.base@17.0.1/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2> at java.base@17.0.1/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) 2> at java.base@17.0.1/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2> at java.base@17.0.1/java.lang.reflect.Method.invoke(Method.java:568) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) 2> at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) 2> at app//org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) 2> at app//org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) 2> at app//org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) 2> at app//org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) 2> at app//org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) 2> at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) 2> at app//org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) 2> at app//org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) 2> at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOn 2> MethodsRule.java:40) 2> at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) 2> at app//org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) 2> at app//org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) 2> at app//org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) 2> at app//org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) 2> at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t2][[timer]]" ID=326 TIMED_WAITING 2> at java.base@17.0.1/java.lang.Thread.sleep(Native Method) 2> at app//org.opensearch.threadpool.ThreadPool$CachedTimeThread.run(ThreadPool.java:631) 2> "opensearch[node_t2][scheduler][T#1]" ID=327 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7a463c02 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - timed waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7a463c02 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1672) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t0][[timer]]" ID=328 TIMED_WAITING 2> at java.base@17.0.1/java.lang.Thread.sleep(Native Method) 2> at app//org.opensearch.threadpool.ThreadPool$CachedTimeThread.run(ThreadPool.java:631) 2> "opensearch[node_t0][scheduler][T#1]" ID=329 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@532e91f6 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - timed waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@532e91f6 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1672) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][[timer]]" ID=330 TIMED_WAITING 2> at java.base@17.0.1/java.lang.Thread.sleep(Native Method) 2> at app//org.opensearch.threadpool.ThreadPool$CachedTimeThread.run(ThreadPool.java:631) 2> "opensearch[node_t1][scheduler][T#1]" ID=331 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@21f5a85a 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - timed waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@21f5a85a 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1672) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t2][transport_worker][T#1]" ID=335 RUNNABLE (in native code) 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> - locked sun.nio.ch.Util$2@79da8ca7 2> - locked sun.nio.ch.EPollSelectorImpl@323709b2 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> Locked synchronizers: 2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@15318f23 2> "opensearch[node_t1][transport_worker][T#1]" ID=336 RUNNABLE (in native code) 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> - locked sun.nio.ch.Util$2@190a52a7 2> - locked sun.nio.ch.EPollSelectorImpl@34185a95 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> Locked synchronizers: 2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@3ee8af3d 2> "opensearch[node_t0][transport_worker][T#1]" ID=337 RUNNABLE (in native code) 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> - locked sun.nio.ch.Util$2@27b97754 2> - locked sun.nio.ch.EPollSelectorImpl@6c6d866e 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> Locked synchronizers: 2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@1ad7b584 2> "opensearch[node_t2][transport_worker][T#2]" ID=338 RUNNABLE (in native code) 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> - locked sun.nio.ch.Util$2@613d60a4 2> - locked sun.nio.ch.EPollSelectorImpl@dd2b800 2> at java.base@17.0.1/sun.nio.ch.SelectorIm 2> pl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> Locked synchronizers: 2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@d8c0122 2> "opensearch[node_t1][transport_worker][T#2]" ID=339 RUNNABLE (in native code) 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> - locked sun.nio.ch.Util$2@2a50fe82 2> - locked sun.nio.ch.EPollSelectorImpl@20e2832c 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> Locked synchronizers: 2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@38e83d88 2> "opensearch[node_t0][transport_worker][T#2]" ID=340 RUNNABLE (in native code) 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> - locked sun.nio.ch.Util$2@5580bea6 2> - locked sun.nio.ch.EPollSelectorImpl@7889fe7a 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> Locked synchronizers: 2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@4cc6f9a4 2> "opensearch[node_t0][generic][T#1]" ID=341 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@353b89c9 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@353b89c9 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t0][clusterApplierService#updateTask][T#1]" ID=342 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@651e6446 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@651e6446 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:535) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t2][generic][T#1]" ID=344 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@52d32cb1 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@52d32cb1 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t2][clusterApplierService#updateTask][T#1]" ID=346 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@29a3f496 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@29a3f496 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:535) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t0][generic][T#2]" ID=347 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@353b89c9 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@353b89c9 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.Linked 2> TransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t2][generic][T#2]" ID=350 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@52d32cb1 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@52d32cb1 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t2][generic][T#3]" ID=351 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@52d32cb1 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@52d32cb1 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t2][generic][T#4]" ID=352 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@52d32cb1 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@52d32cb1 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t0][generic][T#3]" ID=353 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@353b89c9 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@353b89c9 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][generic][T#1]" ID=354 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@40bf45aa 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@40bf45aa 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t0][generic][T#4]" ID=355 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@353b89c9 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@353b89c9 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer( 2> LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][clusterApplierService#updateTask][T#1]" ID=356 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@569525af 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@569525af 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:535) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][generic][T#2]" ID=359 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@40bf45aa 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@40bf45aa 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][generic][T#3]" ID=360 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@40bf45aa 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@40bf45aa 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][generic][T#4]" ID=361 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@40bf45aa 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@40bf45aa 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][masterService#updateTask][T#1]" ID=362 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1de83d68 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1de83d68 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:535) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][management][T#1]" ID=363 TIMED_WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@2bd96d07 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - timed waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@2bd96d07 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/j 2> ava.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][management][T#2]" ID=364 TIMED_WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@2bd96d07 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - timed waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@2bd96d07 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t0][management][T#1]" ID=365 TIMED_WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@11f1ffc3 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - timed waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@11f1ffc3 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][DanglingIndices#updateTask][T#1]" ID=366 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@6eb6180f 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@6eb6180f 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t0][DanglingIndices#updateTask][T#1]" ID=367 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@32697bcc 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@32697bcc 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][write][T#1]" ID=368 WAITING on java.util.concurrent.CountDownLatch$Sync@52b899d3 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on java.util.concurrent.CountDownLatch$Sync@52b899d3 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:211) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:715) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1047) 2> at java.base@17.0.1/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:230) 2> at app//org.opensearch.index.ShardIndexingPressureSettingsIT.lambda$blockPrimary$10(ShardIndexingPressureSettingsIT.java:901) 2> at app//org.opensearch.index.ShardIndexingPressureSettingsIT$$Lambda$4073/0x000000080152eb28.sendRequest(Unknown Source) 2> at app//org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:250) 2> at app//org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) 2> at app//org.opensearch.transport.TransportService$$Lambda$1829/0x000000080118c678.sendRequest(Unknown Source) 2> at app//org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) 2> at app//org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) 2> at app//org.opensearch.action.support.replication.TransportReplicationAction$ReplicasProxy.performOn(TransportReplicationAction.java:1311) 2> at app//org.opensearch.action.support.replication.ReplicationOperation$3.tryAction(ReplicationOperation.java:306) 2> at app//org.opensearch.action.support.RetryableAction$1.doRun(RetryableAction.java:123) 2> at app//org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) 2> at app//org.opensearch.common.util.concurrent.OpenSearchExecutors$DirectExecutorService.execute(OpenSearchExecutors.java:296) 2> at app//org.opensearch.action.support.RetryableAction.run(RetryableAction.java:101) 2> at app//org.opensearch.action.support.replication.ReplicationOperation.performOnReplica(ReplicationOperation.java:325) 2> at app//org.opensearch.action.support.replication.ReplicationOperation.performOnReplicas(ReplicationOperation.java:226) 2> at app//org.opensearch.action.support.replication.ReplicationOperation.handlePrimaryResult(ReplicationOperation.java:174) 2> at app//org.opensearch.action.support.replication.ReplicationOperation$$Lambda$3083/0x00000008013a52a0.accept(Unknown Source) 2> at app//org.opensearch.action.ActionListener$1.onResponse(ActionListener.java:78) 2> at app//org.opensearch.action.ActionListener$4.onResponse(ActionListener.java:178) 2> at app//org.opensearch.action.ActionListener.completeWith(ActionListener.java:351) 2> at app//org.opensearch.action.bulk.TransportShardBulkAction$2.finishRequest(TransportShardBulkAction.java:264) 2> at app//org.opensearch.action.bulk.TransportShardBulkAction$2.doRun(TransportShardBulkAction.java:227) 2> at app//org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) 2> at app//org.opensearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:276) 2> at app//org.opensearch.action.bulk.T 2> ransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:165) 2> at app//org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:98) 2> at app//org.opensearch.action.support.replication.TransportWriteAction$1.doRun(TransportWriteAction.java:220) 2> at app//org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) 2> at app//org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> Locked synchronizers: 2> - java.util.concurrent.ThreadPoolExecutor$Worker@54e4f89f 2> "opensearch[node_t0][write][T#1]" ID=369 WAITING on java.util.concurrent.LinkedTransferQueue@4c297ba0 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on java.util.concurrent.LinkedTransferQueue@4c297ba0 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t0][write][T#2]" ID=370 WAITING on java.util.concurrent.LinkedTransferQueue@4c297ba0 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on java.util.concurrent.LinkedTransferQueue@4c297ba0 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][refresh][T#1]" ID=371 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@1201744a 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@1201744a 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t0][refresh][T#1]" ID=372 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@6bcfcadd 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@6bcfcadd 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][management][T#3]" ID=373 TIMED_WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@2bd96d07 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - timed waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@2bd96d07 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t0][management][T#2]" ID=374 TIMED_WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@11f1ffc3 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - timed waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@11f1ffc3 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo 2> lExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t0][flush][T#1]" ID=375 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@7d2fa076 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@7d2fa076 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> "opensearch[node_t1][flush][T#1]" ID=376 WAITING on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@7a5c2008 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> - waiting on org.opensearch.common.util.concurrent.OpenSearchExecutors$ExecutorScalingQueue@7a5c2008 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> ^^============================================== 2> REPRODUCE WITH: ./gradlew ':server:internalClusterTest' --tests "org.opensearch.index.ShardIndexingPressureSettingsIT.testShardIndexingPressureEnforcedEnabledDisabledSetting" -Dtests.seed=589B15FA746087E9 -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=zh-HK -Dtests.timezone=US/Mountain -Druntime.java=17 2> java.lang.Exception: Test abandoned because suite timeout was reached. at __randomizedtesting.SeedInfo.seed([589B15FA746087E9]:0) 2> 1月 15, 2022 9:47:37 上午 com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks 2> 警告: Will linger awaiting termination of 43 leaked thread(s). 2> 1月 15, 2022 9:47:42 上午 com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks 2> 嚴重: 43 threads leaked from SUITE scope at org.opensearch.index.ShardIndexingPressureSettingsIT: 2> 1) Thread[id=326, name=opensearch[node_t2][[timer]], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/java.lang.Thread.sleep(Native Method) 2> at app//org.opensearch.threadpool.ThreadPool$CachedTimeThread.run(ThreadPool.java:631) 2> 2) Thread[id=329, name=opensearch[node_t0][scheduler][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1672) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 3) Thread[id=354, name=opensearch[node_t1][generic][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 4) Thread[id=366, name=opensearch[node_t1][DanglingIndices#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 5) Thread[id=367, name=opensearch[node_t0][DanglingIndices#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 6) Thread[id=370, name=opensearch[node_t0][write][T#2], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 7) Thread[id=359, name=opensearch[node_t1][generic][T#2], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 8) Thread[id=335, name=opensearch[node_t2 2> ][transport_worker][T#1], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 9) Thread[id=327, name=opensearch[node_t2][scheduler][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1672) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 10) Thread[id=347, name=opensearch[node_t0][generic][T#2], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 11) Thread[id=375, name=opensearch[node_t0][flush][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 12) Thread[id=344, name=opensearch[node_t2][generic][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 13) Thread[id=336, name=opensearch[node_t1][transport_worker][T#1], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 14) Thread[id=346, name=opensearch[node_t2][clusterApplierService#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:535) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 15) Thread[id=338, name=opensearch[node_t2][transport_worker][T#2], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndD 2> oSelect(SelectorImpl.java:129) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 16) Thread[id=328, name=opensearch[node_t0][[timer]], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/java.lang.Thread.sleep(Native Method) 2> at app//org.opensearch.threadpool.ThreadPool$CachedTimeThread.run(ThreadPool.java:631) 2> 17) Thread[id=337, name=opensearch[node_t0][transport_worker][T#1], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 18) Thread[id=374, name=opensearch[node_t0][management][T#2], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 19) Thread[id=372, name=opensearch[node_t0][refresh][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 20) Thread[id=342, name=opensearch[node_t0][clusterApplierService#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:535) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 21) Thread[id=351, name=opensearch[node_t2][generic][T#3], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 22) Thread[id=340, name=opensearch[node_t0][transport_worker][T#2], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 23) Thread[id=330, name=opensearch[node_t1][[timer]], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/java.lang.Thread.sleep(Native Method) 2> at app//org.opensearch.threadpool.ThreadPool$CachedTimeThread.run(ThreadPool.java:631) 2> 24) Thread[id=365, name=opensearch[node_t0][management][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoo 2> lExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 25) Thread[id=341, name=opensearch[node_t0][generic][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 26) Thread[id=363, name=opensearch[node_t1][management][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 27) Thread[id=364, name=opensearch[node_t1][management][T#2], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 28) Thread[id=352, name=opensearch[node_t2][generic][T#4], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 29) Thread[id=376, name=opensearch[node_t1][flush][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 30) Thread[id=339, name=opensearch[node_t1][transport_worker][T#2], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/sun.nio.ch.EPoll.wait(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:118) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 31) Thread[id=331, name=opensearch[node_t1][scheduler][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1672) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 32) Thread[id=361, name=opensearch[node_t1][generic][T#4], sta 2> te=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 33) Thread[id=356, name=opensearch[node_t1][clusterApplierService#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:535) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 34) Thread[id=282, name=TEST-ShardIndexingPressureSettingsIT.testShardIndexingPressureEnforcedEnabledDisabledSetting-seed#[589B15FA746087E9], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:211) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:715) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1047) 2> at app//org.opensearch.common.util.concurrent.BaseFuture$Sync.get(BaseFuture.java:267) 2> at app//org.opensearch.common.util.concurrent.BaseFuture.get(BaseFuture.java:99) 2> at app//org.opensearch.common.util.concurrent.FutureUtils.get(FutureUtils.java:69) 2> at app//org.opensearch.action.support.AdapterActionFuture.actionGet(AdapterActionFuture.java:50) 2> at app//org.opensearch.index.ShardIndexingPressureSettingsIT.lambda$testShardIndexingPressureEnforcedEnabledDisabledSetting$2(ShardIndexingPressureSettingsIT.java:425) 2> at app//org.opensearch.index.ShardIndexingPressureSettingsIT$$Lambda$4106/0x00000008015372b0.run(Unknown Source) 2> at app//org.apache.lucene.util.LuceneTestCase._expectThrows(LuceneTestCase.java:2879) 2> at app//org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2754) 2> at app//org.apache.lucene.util.LuceneTestCase.expectThrows(LuceneTestCase.java:2749) 2> at app//org.opensearch.index.ShardIndexingPressureSettingsIT.testShardIndexingPressureEnforcedEnabledDisabledSetting(ShardIndexingPressureSettingsIT.java:425) 2> at java.base@17.0.1/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2> at java.base@17.0.1/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) 2> at java.base@17.0.1/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2> at java.base@17.0.1/java.lang.reflect.Method.invoke(Method.java:568) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988) 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) 2> at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) 2> at app//org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) 2> at app//org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) 2> at app//org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) 2> at app//org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) 2> at app//org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) 2> at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) 2> at app//org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) 2> at app//org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) 2> at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) 2> at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) 2> at app//org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) 2> at app//org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) 2> at app//org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) 2> at app//org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) 2> at app//org.junit.rules.RunRules.evaluate(RunRules.java:20) 2> at app//com.carrotsearch.rand 2> omizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 35) Thread[id=368, name=opensearch[node_t1][write][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:211) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:715) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1047) 2> at java.base@17.0.1/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:230) 2> at app//org.opensearch.index.ShardIndexingPressureSettingsIT.lambda$blockPrimary$10(ShardIndexingPressureSettingsIT.java:901) 2> at app//org.opensearch.index.ShardIndexingPressureSettingsIT$$Lambda$4073/0x000000080152eb28.sendRequest(Unknown Source) 2> at app//org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:250) 2> at app//org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) 2> at app//org.opensearch.transport.TransportService$$Lambda$1829/0x000000080118c678.sendRequest(Unknown Source) 2> at app//org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) 2> at app//org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) 2> at app//org.opensearch.action.support.replication.TransportReplicationAction$ReplicasProxy.performOn(TransportReplicationAction.java:1311) 2> at app//org.opensearch.action.support.replication.ReplicationOperation$3.tryAction(ReplicationOperation.java:306) 2> at app//org.opensearch.action.support.RetryableAction$1.doRun(RetryableAction.java:123) 2> at app//org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) 2> at app//org.opensearch.common.util.concurrent.OpenSearchExecutors$DirectExecutorService.execute(OpenSearchExecutors.java:296) 2> at app//org.opensearch.action.support.RetryableAction.run(RetryableAction.java:101) 2> at app//org.opensearch.action.support.replication.ReplicationOperation.performOnReplica(ReplicationOperation.java:325) 2> at app//org.opensearch.action.support.replication.ReplicationOperation.performOnReplicas(ReplicationOperation.java:226) 2> at app//org.opensearch.action.support.replication.ReplicationOperation.handlePrimaryResult(ReplicationOperation.java:174) 2> at app//org.opensearch.action.support.replication.ReplicationOperation$$Lambda$3083/0x00000008013a52a0.accept(Unknown Source) 2> at app//org.opensearch.action.ActionListener$1.onResponse(ActionListener.java:78) 2> at app//org.opensearch.action.ActionListener$4.onResponse(ActionListener.java:178) 2> at app//org.opensearch.action.ActionListener.completeWith(ActionListener.java:351) 2> at app//org.opensearch.action.bulk.TransportShardBulkAction$2.finishRequest(TransportShardBulkAction.java:264) 2> at app//org.opensearch.action.bulk.TransportShardBulkAction$2.doRun(TransportShardBulkAction.java:227) 2> at app//org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) 2> at app//org.opensearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:276) 2> at app//org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:165) 2> at app//org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:98) 2> at app//org.opensearch.action.support.replication.TransportWriteAction$1.doRun(TransportWriteAction.java:220) 2> at app//org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) 2> at app//org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 36) Thread[id=355, name=opensearch[node_t0][generic][T#4], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 37) Thread[id=371, name=opensearch[node_t1][refresh][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 38) Thread[id=362, name=opensearch[node_t1][masterService#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:535) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java 2> .util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 39) Thread[id=373, name=opensearch[node_t1][management][T#3], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 40) Thread[id=350, name=opensearch[node_t2][generic][T#2], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 41) Thread[id=369, name=opensearch[node_t0][write][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 42) Thread[id=360, name=opensearch[node_t1][generic][T#3], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 43) Thread[id=353, name=opensearch[node_t0][generic][T#3], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 1月 15, 2022 9:47:42 上午 com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll 2> 資訊: Starting to interrupt leaked threads: 2> 1) Thread[id=326, name=opensearch[node_t2][[timer]], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 2) Thread[id=329, name=opensearch[node_t0][scheduler][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 3) Thread[id=354, name=opensearch[node_t1][generic][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 4) Thread[id=366, name=opensearch[node_t1][DanglingIndices#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 5) Thread[id=367, name=opensearch[node_t0][DanglingIndices#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 6) Thread[id=370, name=opensearch[node_t0][write][T#2], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 7) Thread[id=359, name=opensearch[node_t1][generic][T#2], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 8) Thread[id=335, name=opensearch[node_t2][transport_worker][T#1], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> 9) Thread[id=327, name=opensearch[node_t2][scheduler][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 10) Thread[id=347, name=opensearch[node_t0][generic][T#2], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 11) Thread[id=375, name=opensearch[node_t0][flush][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 12) Thread[id=344, name=opensearch[node_t2][generic][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 13) Thread[id=336, name=opensearch[node_t1][transport_worker][T#1], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> 14) Thread[id=346, name=opensearch[node_t2][clusterApplierService#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 15) Thread[id=338, name=opensearch[node_t2][transport_worker][T#2], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> 16) Thread[id=328, name=opensearch[node_t0][[timer]], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 17) Thread[id=337, name=opensearch[node_t0][transport_worker][T#1], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> 18) Thread[id=374, name=opensearch[node_t0][management][T#2], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 19) Thread[id=372, name=opensearch[node_t0][refresh][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 20) Thread[id=342, name=opensearch[node_t0][clusterApplierService#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 21) Thread[id=351, name=opensearch[node_t2][generic][T#3], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 22) Thread[id=340, name=opensearch[node_t0][transport_worker][T#2], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> 23) Thread[id=330, name=opensearch[node_t1][[timer]], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 24) Thread[id=365, name=opensearch[node_t0][management][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 25) Thread[id=341, name=opensearch[node_t0][generic][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 26) Thread[id=363, name=opensearch[node_t1][management][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 27) Thread[id=364, name=opensearch[node_t1][management][T#2], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 28) Thread[id=352, name=opensearch[node_t2][generic][T#4], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 29) Thread[id=376, name=opensearch[node_t1][flush][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 30) Thread[id=339, name=opensearch[node_t1][transport_worker][T#2], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> 31) Thread[id=331, name=opensearch[node_t1][scheduler][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 32) Thread[id=361, name=opensearch[node_t1][generic][T#4], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 33) Thread[id=356, name=opensearch[node_t1][clusterApplierService#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 34) Thread[id=282, name=TEST-ShardIndexingPressureSettingsIT.testShardIndexingPressureEnforcedEnabledDisabledSetting-seed#[589B15FA746087E9], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 35) Thread[id=368, name=opensearch[node_t1][write][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 36) Thread[id=355, name=opensearch[node_t0][generic][T#4], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 37) Thread[id=371, name=opensearch[node_t1][refresh][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 38) Thread[id=362, name=opensearch[node_t1][masterService#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 39) Thread[id=373, name=opensearch[node_t1][management][T#3], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 40) Thread[id=350, name=opensearch[node_t2][generic][T#2], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 41) Thread[id=369, name=opensearch[node_t0][write][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 42) Thread[id=360, name=opensearch[node_t1][generic][T#3], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> 43) Thread[id=353, name=opensearch[node_t0][generic][T#3], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 1> [2022-01-15T09:47:42,632][INFO ][o.o.i.ShardIndexingPressureSettingsIT] [testShardIndexingPressureEnforcedEnabledDisabledSetting] [ShardIndexingPressureSettingsIT#testShardIndexingPressureEnforcedEnabledDisabledSetting]: cleaning up after test 1> [2022-01-15T09:47:42,633][WARN ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] lock assertion failed 1> java.nio.channels.ClosedByInterruptException: null 1> at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:199) ~[?:?] 1> at sun.nio.ch.FileChannelImpl.endBlocking(FileChannelImpl.java:168) ~[?:?] 1> at sun.nio.ch.FileChannelImpl.size(FileChannelImpl.java:392) ~[?:?] 1> at org.apache.lucene.mockfile.FilterFileChannel.size(FilterFileChannel.java:85) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.store.NativeFSLockFactory$NativeFSLock.ensureValid(NativeFSLockFactory.java:182) ~[lucene-core-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:05] 1> at org.opensearch.env.NodeEnvironment.assertEnvIsLocked(NodeEnvironment.java:1085) [main/:?] 1> at org.opensearch.env.NodeEnvironment.nodeDataPaths(NodeEnvironment.java:847) [main/:?] 1> at org.opensearch.test.InternalTestCluster$NodeAndClient.markNodeDataDirsAsPendingForWipe(InternalTestCluster.java:1062) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.InternalTestCluster$NodeAndClient.close(InternalTestCluster.java:1046) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:87) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:129) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:112) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.InternalTestCluster.close(InternalTestCluster.java:895) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:87) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:129) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:112) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.OpenSearchIntegTestCase.clearClusters(OpenSearchIntegTestCase.java:560) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.OpenSearchIntegTestCase.afterInternal(OpenSearchIntegTestCase.java:610) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.OpenSearchIntegTestCase.cleanUpCluster(OpenSearchIntegTestCase.java:2250) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at jdk.internal.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) ~[?:?] 1> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.2.jar:4.13.2] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.2.jar:4.13.2] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.2.jar:4.13.2] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T09:47:42,635][WARN ][o.o.a.b.TransportShardBulkAction] [node_t1] [[test_index][0]] failed to perform indices:data/write/bulk[s] on replica [test_index][0], node[IdHo1pXgRVSr0AV5_fAddg], [R], s[STARTED], a[id=ySgSrLNvQIGCK1lgZ4cEcw] 1> org.opensearch.transport.SendRequestTransportException: [node_t0][127.0.0.1:42923][indices:data/write/bulk[s][r]] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:882) ~[main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) ~[main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) ~[main/:?] 1> at org.opensearch.action.support.replication.TransportReplicationAction$ReplicasProxy.performOn(TransportReplicationAction.java:1311) ~[main/:?] 1> at org.opensearch.action.support.replication.ReplicationOperation$3.tryAction(ReplicationOperation.java:306) ~[main/:?] 1> at org.opensearch.action.support.RetryableAction$1.doRun(RetryableAction.java:123) ~[main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) ~[main/:?] 1> at org.opensearch.common.util.concurrent.OpenSearchExecutors$DirectExecutorService.execute(OpenSearchExecutors.java:296) ~[main/:?] 1> at org.opensearch.action.support.RetryableAction.run(RetryableAction.java:101) ~[main/:?] 1> at org.opensearch.action.support.replication.ReplicationOperation.performOnReplica(ReplicationOperation.java:325) ~[main/:?] 1> at org.opensearch.action.support.replication.ReplicationOperation.performOnReplicas(ReplicationOperation.java:226) ~[main/:?] 1> at org.opensearch.action.support.replication.ReplicationOperation.handlePrimaryResult(ReplicationOperation.java:174) ~[main/:?] 1> at org.opensearch.action.ActionListener$1.onResponse(ActionListener.java:78) ~[main/:?] 1> at org.opensearch.action.ActionListener$4.onResponse(ActionListener.java:178) ~[main/:?] 1> at org.opensearch.action.ActionListener.completeWith(ActionListener.java:351) ~[main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction$2.finishRequest(TransportShardBulkAction.java:264) ~[main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction$2.doRun(TransportShardBulkAction.java:227) ~[main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) ~[main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:276) ~[main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:165) ~[main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:98) ~[main/:?] 1> at org.opensearch.action.support.replication.TransportWriteAction$1.doRun(TransportWriteAction.java:220) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) [main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) [main/:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> Caused by: java.lang.IllegalStateException: java.lang.InterruptedException 1> at org.opensearch.index.ShardIndexingPressureSettingsIT.lambda$blockPrimary$10(ShardIndexingPressureSettingsIT.java:903) ~[internalClusterTest/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:250) ~[framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) ~[main/:?] 1> ... 26 more 1> Caused by: java.lang.InterruptedException 1> at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1048) ~[?:?] 1> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:230) ~[?:?] 1> at org.opensearch.index.ShardIndexingPressureSettingsIT.lambda$blockPrimary$10(ShardIndexingPressureSettingsIT.java:901) ~[internalClusterTest/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:250) ~[framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) ~[main/:?] 1> ... 26 more 1> [2022-01-15T09:47:42,635][WARN ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] lock assertion failed 1> java.nio.channels.ClosedByInterruptException: null 1> at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:199) ~[?:?] 1> at sun.nio.ch.FileChannelImpl.endBlocking(FileChannelImpl.java:168) ~[?:?] 1> at sun.nio.ch.FileChannelImpl.size(FileChannelImpl.java:392) ~[?:?] 1> at org.apache.lucene.mockfile.FilterFileChannel.size(FilterFileChannel.java:85) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.store.NativeFSLockFactory$NativeFSLock.ensureValid(NativeFSLockFactory.java:182) ~[lucene-core-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:05] 1> at org.opensearch.env.NodeEnvironment.assertEnvIsLocked(NodeEnvironment.java:1085) [main/:?] 1> at org.opensearch.env.NodeEnvironment.nodeDataPaths(NodeEnvironment.java:847) [main/:?] 1> at org.opensearch.test.InternalTestCluster$NodeAndClient.markNodeDataDirsAsPendingForWipe(InternalTestCluster.java:1062) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.InternalTestCluster$NodeAndClient.close(InternalTestCluster.java:1046) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:87) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:129) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:112) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.InternalTestCluster.close(InternalTestCluster.java:895) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:87) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:129) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:112) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.OpenSearchIntegTestCase.clearClusters(OpenSearchIntegTestCase.java:560) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.OpenSearchIntegTestCase.afterInternal(OpenSearchIntegTestCase.java:610) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.OpenSearchIntegTestCase.cleanUpCluster(OpenSearchIntegTestCase.java:2250) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at jdk.internal.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) ~[?:?] 1> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.2.jar:4.13.2] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.2.jar:4.13.2] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.2.jar:4.13.2] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T09:47:42,638][WARN ][o.o.e.NodeEnvironment ] [testShardIndexingPressureEnforcedEnabledDisabledSetting] lock assertion failed 1> java.nio.channels.ClosedByInterruptException: null 1> at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:199) ~[?:?] 1> at sun.nio.ch.FileChannelImpl.endBlocking(FileChannelImpl.java:168) ~[?:?] 1> at sun.nio.ch.FileChannelImpl.size(FileChannelImpl.java:392) ~[?:?] 1> at org.apache.lucene.mockfile.FilterFileChannel.size(FilterFileChannel.java:85) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.store.NativeFSLockFactory$NativeFSLock.ensureValid(NativeFSLockFactory.java:182) ~[lucene-core-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:05] 1> at org.opensearch.env.NodeEnvironment.assertEnvIsLocked(NodeEnvironment.java:1085) [main/:?] 1> at org.opensearch.env.NodeEnvironment.nodeDataPaths(NodeEnvironment.java:847) [main/:?] 1> at org.opensearch.test.InternalTestCluster$NodeAndClient.markNodeDataDirsAsPendingForWipe(InternalTestCluster.java:1062) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.InternalTestCluster$NodeAndClient.close(InternalTestCluster.java:1046) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:87) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:129) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:112) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.InternalTestCluster.close(InternalTestCluster.java:895) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:87) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:129) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.core.internal.io.IOUtils.close(IOUtils.java:112) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.OpenSearchIntegTestCase.clearClusters(OpenSearchIntegTestCase.java:560) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.OpenSearchIntegTestCase.afterInternal(OpenSearchIntegTestCase.java:610) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.test.OpenSearchIntegTestCase.cleanUpCluster(OpenSearchIntegTestCase.java:2250) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at jdk.internal.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) ~[?:?] 1> at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 1> at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.2.jar:4.13.2] 1> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.2.jar:4.13.2] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.junit.rules.RunRules.evaluate(RunRules.java:20) [junit-4.13.2.jar:4.13.2] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [randomizedtesting-runner-2.7.1.jar:?] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [randomizedtesting-runner-2.7.1.jar:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 2> NOTE: leaving temporary files on disk at: /home/ubuntu/os/OpenSearch/server/build/testrun/internalClusterTest/temp/org.opensearch.index.ShardIndexingPressureSettingsIT_589B15FA746087E9-001 1> [2022-01-15T09:47:42,643][WARN ][o.o.c.r.a.AllocationService] [node_t1] failing shard [failed shard, shard [test_index][0], node[IdHo1pXgRVSr0AV5_fAddg], [R], s[STARTED], a[id=ySgSrLNvQIGCK1lgZ4cEcw], message [failed to perform indices:data/write/bulk[s] on replica [test_index][0], node[IdHo1pXgRVSr0AV5_fAddg], [R], s[STARTED], a[id=ySgSrLNvQIGCK1lgZ4cEcw]], failure [SendRequestTransportException[[node_t0][127.0.0.1:42923][indices:data/write/bulk[s][r]]]; nested: IllegalStateException[java.lang.InterruptedException]; nested: InterruptedException; ], markAsStale [true]] 1> org.opensearch.transport.SendRequestTransportException: [node_t0][127.0.0.1:42923][indices:data/write/bulk[s][r]] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:882) ~[main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) ~[main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) ~[main/:?] 1> at org.opensearch.action.support.replication.TransportReplicationAction$ReplicasProxy.performOn(TransportReplicationAction.java:1311) ~[main/:?] 1> at org.opensearch.action.support.replication.ReplicationOperation$3.tryAction(ReplicationOperation.java:306) ~[main/:?] 1> at org.opensearch.action.support.RetryableAction$1.doRun(RetryableAction.java:123) ~[main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) ~[main/:?] 1> at org.opensearch.common.util.concurrent.OpenSearchExecutors$DirectExecutorService.execute(OpenSearchExecutors.java:296) ~[main/:?] 1> at org.opensearch.action.support.RetryableAction.run(RetryableAction.java:101) ~[main/:?] 1> at org.opensearch.action.support.replication.ReplicationOperation.performOnReplica(ReplicationOperation.java:325) ~[main/:?] 1> at org.opensearch.action.support.replication.ReplicationOperation.performOnReplicas(ReplicationOperation.java:226) ~[main/:?] 1> at org.opensearch.action.support.replication.ReplicationOperation.handlePrimaryResult(ReplicationOperation.java:174) ~[main/:?] 1> at org.opensearch.action.ActionListener$1.onResponse(ActionListener.java:78) ~[main/:?] 1> at org.opensearch.action.ActionListener$4.onResponse(ActionListener.java:178) ~[main/:?] 1> at org.opensearch.action.ActionListener.completeWith(ActionListener.java:351) ~[main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction$2.finishRequest(TransportShardBulkAction.java:264) ~[main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction$2.doRun(TransportShardBulkAction.java:227) ~[main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) ~[main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:276) ~[main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:165) ~[main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:98) ~[main/:?] 1> at org.opensearch.action.support.replication.TransportWriteAction$1.doRun(TransportWriteAction.java:220) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) ~[main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) ~[main/:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> Caused by: java.lang.IllegalStateException: java.lang.InterruptedException 1> at org.opensearch.index.ShardIndexingPressureSettingsIT.lambda$blockPrimary$10(ShardIndexingPressureSettingsIT.java:903) ~[internalClusterTest/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:250) ~[framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) ~[main/:?] 1> ... 26 more 1> Caused by: java.lang.InterruptedException 1> at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1048) ~[?:?] 1> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:230) ~[?:?] 1> at org.opensearch.index.ShardIndexingPressureSettingsIT.lambda$blockPrimary$10(ShardIndexingPressureSettingsIT.java:901) ~[internalClusterTest/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:250) ~[framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) ~[main/:?] 1> ... 26 more 1> [2022-01-15T09:47:42,646][INFO ][o.o.c.r.a.AllocationService] [node_t1] Cluster health status changed from [GREEN] to [YELLOW] (reason: [shards failed [[test_index][0]]]). 1> [2022-01-15T16:47:42,645][WARN ][o.o.t.OutboundHandler ] [node_t1] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:45001, remoteAddress=/127.0.0.1:60488}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendErrorResponse(OutboundHandler.java:180) [main/:?] 1> at org.opensearch.transport.TcpTransportChannel.sendResponse(TcpTransportChannel.java:99) [main/:?] 1> at org.opensearch.transport.TaskTransportChannel.sendResponse(TaskTransportChannel.java:74) [main/:?] 1> at org.opensearch.transport.TransportChannel.sendErrorResponse(TransportChannel.java:69) [main/:?] 1> at org.opensearch.action.support.ChannelActionListener.onFailure(ChannelActionListener.java:65) [main/:?] 1> at org.opensearch.action.ActionListener$6.onFailure(ActionListener.java:307) [main/:?] 1> at org.opensearch.action.support.replication.TransportReplicationAction$ReroutePhase.finishAsFailed(TransportReplicationAction.java:1067) [main/:?] 1> at org.opensearch.action.support.replication.TransportReplicationAction$ReroutePhase$1.handleException(TransportReplicationAction.java:1025) [main/:?] 1> at org.opensearch.transport.TransportService$6.handleException(TransportService.java:735) [main/:?] 1> at org.opensearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1350) [main/:?] 1> at org.opensearch.transport.TransportService$DirectResponseChannel.processException(TransportService.java:1459) [main/:?] 1> at org.opensearch.transport.TransportService$DirectResponseChannel.sendResponse(TransportService.java:1433) [main/:?] 1> at org.opensearch.transport.TaskTransportChannel.sendResponse(TaskTransportChannel.java:74) [main/:?] 1> at org.opensearch.transport.TransportChannel.sendErrorResponse(TransportChannel.java:69) [main/:?] 1> at org.opensearch.action.support.ChannelActionListener.onFailure(ChannelActionListener.java:65) [main/:?] 1> at org.opensearch.action.ActionListener$6.onFailure(ActionListener.java:307) [main/:?] 1> at org.opensearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.onFailure(TransportReplicationAction.java:545) [main/:?] 1> at org.opensearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.handleException(TransportReplicationAction.java:539) [main/:?] 1> at org.opensearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$runWithPrimaryShardReference$3(TransportReplicationAction.java:517) [main/:?] 1> at org.opensearch.action.ActionListener$1.onFailure(ActionListener.java:86) [main/:?] 1> at org.opensearch.action.ActionListener$4.onFailure(ActionListener.java:188) [main/:?] 1> at org.opensearch.action.support.replication.ReplicationOperation.finishAsFailed(ReplicationOperation.java:426) [main/:?] 1> at org.opensearch.action.ActionListener$1.onFailure(ActionListener.java:86) [main/:?] 1> at org.opensearch.action.ActionListener$4.onFailure(ActionListener.java:188) [main/:?] 1> at org.opensearch.action.ActionRunnable.onFailure(ActionRunnable.java:101) [main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:52) [main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:276) [main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:165) [main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:98) [main/:?] 1> at org.opensearch.action.support.replication.TransportWriteAction$1.doRun(TransportWriteAction.java:220) [main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) [main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) [main/:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T16:47:42,647][WARN ][o.o.t.TransportChannel ] [node_t1] Failed to send error response for action [indices:data/write/bulk[s]] and request [BulkShardRequest [[test_index][0]] containing [80] requests] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler.sendErrorResponse(OutboundHandler.java:180) ~[main/:?] 1> at org.opensearch.transport.TcpTransportChannel.sendResponse(TcpTransportChannel.java:99) ~[main/:?] 1> at org.opensearch.transport.TaskTransportChannel.sendResponse(TaskTransportChannel.java:74) ~[main/:?] 1> at org.opensearch.transport.TransportChannel.sendErrorResponse(TransportChannel.java:69) [main/:?] 1> at org.opensearch.action.support.ChannelActionListener.onFailure(ChannelActionListener.java:65) [main/:?] 1> at org.opensearch.action.ActionListener$6.onFailure(ActionListener.java:307) [main/:?] 1> at org.opensearch.action.support.replication.TransportReplicationAction$ReroutePhase.finishAsFailed(TransportReplicationAction.java:1067) [main/:?] 1> at org.opensearch.action.support.replication.TransportReplicationAction$ReroutePhase$1.handleException(TransportReplicationAction.java:1025) [main/:?] 1> at org.opensearch.transport.TransportService$6.handleException(TransportService.java:735) [main/:?] 1> at org.opensearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1350) [main/:?] 1> at org.opensearch.transport.TransportService$DirectResponseChannel.processException(TransportService.java:1459) [main/:?] 1> at org.opensearch.transport.TransportService$DirectResponseChannel.sendResponse(TransportService.java:1433) [main/:?] 1> at org.opensearch.transport.TaskTransportChannel.sendResponse(TaskTransportChannel.java:74) [main/:?] 1> at org.opensearch.transport.TransportChannel.sendErrorResponse(TransportChannel.java:69) [main/:?] 1> at org.opensearch.action.support.ChannelActionListener.onFailure(ChannelActionListener.java:65) [main/:?] 1> at org.opensearch.action.ActionListener$6.onFailure(ActionListener.java:307) [main/:?] 1> at org.opensearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.onFailure(TransportReplicationAction.java:545) [main/:?] 1> at org.opensearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.handleException(TransportReplicationAction.java:539) [main/:?] 1> at org.opensearch.action.support.replication.TransportReplicationAction$AsyncPrimaryAction.lambda$runWithPrimaryShardReference$3(TransportReplicationAction.java:517) [main/:?] 1> at org.opensearch.action.ActionListener$1.onFailure(ActionListener.java:86) [main/:?] 1> at org.opensearch.action.ActionListener$4.onFailure(ActionListener.java:188) [main/:?] 1> at org.opensearch.action.support.replication.ReplicationOperation.finishAsFailed(ReplicationOperation.java:426) [main/:?] 1> at org.opensearch.action.ActionListener$1.onFailure(ActionListener.java:86) [main/:?] 1> at org.opensearch.action.ActionListener$4.onFailure(ActionListener.java:188) [main/:?] 1> at org.opensearch.action.ActionRunnable.onFailure(ActionRunnable.java:101) [main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:52) [main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:276) [main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:165) [main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:98) [main/:?] 1> at org.opensearch.action.support.replication.TransportWriteAction$1.doRun(TransportWriteAction.java:220) [main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) [main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) [main/:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> Suppressed: org.opensearch.transport.RemoteTransportException: [node_t1][127.0.0.1:45001][indices:data/write/bulk[s][p]] 1> Caused by: java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.util.MockBigArrays.newByteArray(MockBigArrays.java:126) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.index.translog.Translog.add(Translog.java:592) ~[main/:?] 1> at org.opensearch.index.engine.InternalEngine.index(InternalEngine.java:1073) ~[main/:?] 1> at org.opensearch.index.shard.IndexShard.index(IndexShard.java:970) ~[main/:?] 1> at org.opensearch.index.shard.IndexShard.applyIndexOperation(IndexShard.java:914) ~[main/:?] 1> at org.opensearch.index.shard.IndexShard.applyIndexOperationOnPrimary(IndexShard.java:815) ~[main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.executeBulkItemRequest(TransportShardBulkAction.java:351) ~[main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction$2.doRun(TransportShardBulkAction.java:212) ~[main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) [main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.performOnPrimary(TransportShardBulkAction.java:276) [main/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:165) [ma 1> in/:?] 1> at org.opensearch.action.bulk.TransportShardBulkAction.dispatchedShardOperationOnPrimary(TransportShardBulkAction.java:98) [main/:?] 1> at org.opensearch.action.support.replication.TransportWriteAction$1.doRun(TransportWriteAction.java:220) [main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) [main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) [main/:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T09:47:42,648][WARN ][o.o.t.OutboundHandler ] [node_t1] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:56312, remoteAddress=127.0.0.1/127.0.0.1:42923}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport$NodeChannels.sendRequest(TcpTransport.java:309) [main/:?] 1> at org.opensearch.index.ShardIndexingPressureSettingsIT.lambda$blockPrimary$10(ShardIndexingPressureSettingsIT.java:906) [internalClusterTest/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:250) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) [main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler$PublicationContext.sendClusterState(PublicationTransportHandler.java:472) [main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler$PublicationContext.sendClusterStateDiff(PublicationTransportHandler.java:429) [main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler$PublicationContext.sendPublishRequest(PublicationTransportHandler.java:364) [main/:?] 1> at org.opensearch.cluster.coordination.Coordinator$CoordinatorPublication.sendPublishRequest(Coordinator.java:1730) [main/:?] 1> at org.opensearch.cluster.coordination.Publication$PublicationTarget.sendPublishRequest(Publication.java:274) [main/:?] 1> at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?] 1> at org.opensearch.cluster.coordination.Publication.start(Publication.java:86) [main/:?] 1> at org.opensearch.cluster.coordination.Coordinator.publish(Coordinator.java:1287) [main/:?] 1> at org.opensearch.cluster.service.MasterService.publish(MasterService.java:303) [main/:?] 1> at org.opensearch.cluster.service.MasterService.runTasks(MasterService.java:285) [main/:?] 1> at org.opensearch.cluster.service.MasterService.access$000(MasterService.java:86) [main/:?] 1> at org.opensearch.cluster.service.MasterService$Batcher.run(MasterService.java:173) [main/:?] 1> at org.opensearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:175) [main/:?] 1> at org.opensearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:213) [main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [main/:?] 1> at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedOpenSearchThreadPoolExecutor.java:275) [main/:?] 1> at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedOpenSearchThreadPoolExecutor.java:238) [main/:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T09:47:42,650][WARN ][o.o.t.OutboundHandler ] [node_t1] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:41480, remoteAddress=127.0.0.1/127.0.0.1:40645}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport$NodeChannels.sendRequest(TcpTransport.java:309) [main/:?] 1> at org.opensearch.index.ShardIndexingPressureSettingsIT.lambda$blockPrimary$10(ShardIndexingPressureSettingsIT.java:906) [internalClusterTest/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:250) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) [main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler$PublicationContext.sendClusterState(PublicationTransportHandler.java:472) [main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler$PublicationContext.sendClusterStateDiff(PublicationTransportHandler.java:429) [main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler$PublicationContext.sendPublishRequest(PublicationTransportHandler.java:364) [main/:?] 1> at org.opensearch.cluster.coordination.Coordinator$CoordinatorPublication.sendPublishRequest(Coordinator.java:1730) [main/:?] 1> at org.opensearch.cluster.coordination.Publication$PublicationTarget.sendPublishRequest(Publication.java:274) [main/:?] 1> at java.util.ArrayList.forEach(ArrayList.java:1511) [?:?] 1> at org.opensearch.cluster.coordination.Publication.start(Publication.java:86) [main/:?] 1> at org.opensearch.cluster.coordination.Coordinator.publish(Coordinator.java:1287) [main/:?] 1> at org.opensearch.cluster.service.MasterService.publish(MasterService.java:303) [main/:?] 1> at org.opensearch.cluster.service.MasterService.runTasks(MasterService.java:285) [main/:?] 1> at org.opensearch.cluster.service.MasterService.access$000(MasterService.java:86) [main/:?] 1> at org.opensearch.cluster.service.MasterService$Batcher.run(MasterService.java:173) [main/:?] 1> at org.opensearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:175) [main/:?] 1> at org.opensearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:213) [main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [main/:?] 1> at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedOpenSearchThreadPoolExecutor.java:275) [main/:?] 1> at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedOpenSearchThreadPoolExecutor.java:238) [main/:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T09:47:42,655][INFO ][o.o.c.s.ClusterApplierService] [node_t1] master node changed {previous [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}], current []}, term: 2, version: 18, reason: becoming candidate: Publication.onCompletion(false) 1> [2022-01-15T09:47:42,655][WARN ][o.o.c.s.MasterService ] [node_t1] failing [shard-failed[shard id [[test_index][0]], allocation id [ySgSrLNvQIGCK1lgZ4cEcw], primary term [1], message [failed to perform indices:data/write/bulk[s] on replica [test_index][0], node[IdHo1pXgRVSr0AV5_fAddg], [R], s[STARTED], a[id=ySgSrLNvQIGCK1lgZ4cEcw]], failure [SendRequestTransportException[[node_t0][127.0.0.1:42923][indices:data/write/bulk[s][r]]]; nested: IllegalStateException[java.lang.InterruptedException]; nested: InterruptedException; ], markAsStale [true]]]: failed to commit cluster state version [19] 1> org.opensearch.cluster.coordination.FailedToCommitClusterStateException: publication failed 1> at org.opensearch.cluster.coordination.Coordinator$CoordinatorPublication$4.onFailure(Coordinator.java:1665) ~[main/:?] 1> at org.opensearch.action.ActionRunnable.onFailure(ActionRunnable.java:101) ~[main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:52) ~[main/:?] 1> at org.opensearch.common.util.concurrent.OpenSearchExecutors$DirectExecutorService.execute(OpenSearchExecutors.java:296) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:118) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ListenableFuture.addListener(ListenableFuture.java:80) ~[main/:?] 1> at org.opensearch.cluster.coordination.Coordinator$CoordinatorPublication.onCompletion(Coordinator.java:1576) ~[main/:?] 1> at org.opensearch.cluster.coordination.Publication.onPossibleCompletion(Publication.java:138) ~[main/:?] 1> at org.opensearch.cluster.coordination.Publication.onPossibleCommitFailure(Publication.java:189) ~[main/:?] 1> at org.opensearch.cluster.coordination.Publication.access$500(Publication.java:55) ~[main/:?] 1> at org.opensearch.cluster.coordination.Publication$PublicationTarget$PublishResponseHandler.onFailure(Publication.java:396) ~[main/:?] 1> at org.opensearch.cluster.coordination.Coordinator$5.onFailure(Coordinator.java:1324) ~[main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler$PublicationContext$1.onFailure(PublicationTransportHandler.java:353) ~[main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler$PublicationContext.lambda$sendClusterState$2(PublicationTransportHandler.java:446) ~[main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler$PublicationContext$3.handleException(PublicationTransportHandler.java:464) ~[main/:?] 1> at org.opensearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1350) ~[main/:?] 1> at org.opensearch.transport.TransportService$DirectResponseChannel.processException(TransportService.java:1459) ~[main/:?] 1> at org.opensearch.transport.TransportService$DirectResponseChannel$2.run(TransportService.java:1438) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) ~[main/:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> Caused by: java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.util.MockBigArrays.newByteArray(MockBigArrays.java:126) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:507) ~[main/:?] 1> at org.opensearch.gateway.PersistedClusterStateService$DocumentBuffer.(PersistedClusterStateService.java:945) ~[main/:?] 1> at org.opensearch.gateway.PersistedClusterStateService$Writer.allocateBuffer(PersistedClusterStateService.java:833) ~[main/:?] 1> at org.opensearch.gateway.PersistedClusterStateService$Writer.updateMetadata(PersistedClusterStateService.java:725) ~[main/:?] 1> at org.opensearch.gateway.PersistedClusterStateService$Writer.writeIncrementalStateAndCommit(PersistedClusterStateService.java:679) ~[main/:?] 1> at org.opensearch.gateway.GatewayMetaState$LucenePersistedState.setLastAcceptedState(GatewayMetaState.java:560) ~[main/:?] 1> at org.opensearch.cluster.coordination.CoordinationState.handlePublishRequest(CoordinationState.java:437) ~[main/:?] 1> at org.opensearch.cluster.coordination.Coordinator.handlePublishRequest(Coordinator.java:431) ~[main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler.acceptState(PublicationTransportHandler.java:235) ~[main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler.handleIncomingPublishRequest(PublicationTransportHandler.java:218) ~[main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler.lambda$new$0(PublicationTransportHandler.java:120) ~[main/:?] 1> at org.opensearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:98) ~[main/:?] 1> at org.opensearch.transport.TransportService$8.doRun(TransportService.java:937) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) ~[main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) ~[main/:?] 1> ... 3 more 1> [2022-01-15T09:47:42,656][WARN ][o.o.t.OutboundHandler ] [node_t1] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:37758, remoteAddress=127.0.0.1/127.0.0.1:42923}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport.lambda$new$1(TcpTransport.java:188) [main/:?] 1> at org.opensearch.transport.TransportHandshaker.sendHandshake(TransportHandshaker.java:98) [main/:?] 1> at org.opensearch.transport.TcpTransport.executeHandshake(TcpTransport.java:889) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1035) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1008) [main/:?] 1> at org.opensearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:211) [main/:?] 1> at org.opensearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:52) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863) [?:?] 1> at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841) [?:?] 1> at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) [?:?] 1> at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147) [?:?] 1> at org.opensearch.common.concurrent.CompletableContext.complete(CompletableContext.java:74) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.SocketChannelContext.connect(SocketChannelContext.java:165) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.EventHandler.handleConnect(EventHandler.java:130) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.nio.TestEventHandler.handleConnect(TestEventHandler.java:139) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.attemptConnect(NioSelector.java:446) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.registerChannel(NioSelector.java:469) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.setUpNewChannels(NioSelector.java:458) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.preSelect(NioSelector.java:279) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:172) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T09:47:42,657][ERROR][o.o.c.a.s.ShardStateAction] [node_t1] [test_index][0] unexpected failure while failing shard [shard id [[test_index][0]], allocation id [ySgSrLNvQIGCK1lgZ4cEcw], primary term [1], message [failed to perform indices:data/write/bulk[s] on replica [test_index][0], node[IdHo1pXgRVSr0AV5_fAddg], [R], s[STARTED], a[id=ySgSrLNvQIGCK1lgZ4cEcw]], failure [SendRequestTransportException[[node_t0][127.0.0.1:42923][indices:data/write/bulk[s][r]]]; nested: IllegalStateException[java.lang.InterruptedException]; nested: InterruptedException; ], markAsStale [true]] 1> org.opensearch.cluster.coordination.FailedToCommitClusterStateException: publication failed 1> at org.opensearch.cluster.coordination.Coordinator$CoordinatorPublication$4.onFailure(Coordinator.java:1665) ~[main/:?] 1> at org.opensearch.action.ActionRunnable.onFailure(ActionRunnable.java:101) ~[main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:52) ~[main/:?] 1> at org.opensearch.common.util.concurrent.OpenSearchExecutors$DirectExecutorService.execute(OpenSearchExecutors.java:296) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ListenableFuture.notifyListener(ListenableFuture.java:118) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ListenableFuture.addListener(ListenableFuture.java:80) ~[main/:?] 1> at org.opensearch.cluster.coordination.Coordinator$CoordinatorPublication.onCompletion(Coordinator.java:1576) ~[main/:?] 1> at org.opensearch.cluster.coordination.Publication.onPossibleCompletion(Publication.java:138) ~[main/:?] 1> at org.opensearch.cluster.coordination.Publication.onPossibleCommitFailure(Publication.java:189) ~[main/:?] 1> at org.opensearch.cluster.coordination.Publication.access$500(Publication.java:55) ~[main/:?] 1> at org.opensearch.cluster.coordination.Publication$PublicationTarget$PublishResponseHandler.onFailure(Publication.java:396) ~[main/:?] 1> at org.opensearch.cluster.coordination.Coordinator$5.onFailure(Coordinator.java:1324) ~[main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler$PublicationContext$1.onFailure(PublicationTransportHandler.java:353) ~[main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler$PublicationContext.lambda$sendClusterState$2(PublicationTransportHandler.java:446) ~[main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler$PublicationContext$3.handleException(PublicationTransportHandler.java:464) ~[main/:?] 1> at org.opensearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1350) ~[main/:?] 1> at org.opensearch.transport.TransportService$DirectResponseChannel.processException(TransportService.java:1459) ~[main/:?] 1> at org.opensearch.transport.TransportService$DirectResponseChannel$2.run(TransportService.java:1438) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) ~[main/:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> Caused by: java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.util.MockBigArrays.newByteArray(MockBigArrays.java:126) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:507) ~[main/:?] 1> at org.opensearch.gateway.PersistedClusterStateService$DocumentBuffer.(PersistedClusterStateService.java:945) ~[main/:?] 1> at org.opensearch.gateway.PersistedClusterStateService$Writer.allocateBuffer(PersistedClusterStateService.java:833) ~[main/:?] 1> at org.opensearch.gateway.PersistedClusterStateService$Writer.updateMetadata(PersistedClusterStateService.java:725) ~[main/:?] 1> at org.opensearch.gateway.PersistedClusterStateService$Writer.writeIncrementalStateAndCommit(PersistedClusterStateService.java:679) ~[main/:?] 1> at org.opensearch.gateway.GatewayMetaState$LucenePersistedState.setLastAcceptedState(GatewayMetaState.java:560) ~[main/:?] 1> at org.opensearch.cluster.coordination.CoordinationState.handlePublishRequest(CoordinationState.java:437) ~[main/:?] 1> at org.opensearch.cluster.coordination.Coordinator.handlePublishRequest(Coordinator.java:431) ~[main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler.acceptState(PublicationTransportHandler.java:235) ~[main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler.handleIncomingPublishRequest(PublicationTransportHandler.java:218) ~[main/:?] 1> at org.opensearch.cluster.coordination.PublicationTransportHandler.lambda$new$0(PublicationTransportHandler.java:120) ~[main/:?] 1> at org.opensearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:98) ~[main/:?] 1> at org.opensearch.transport.TransportService$8.doRun(TransportService.java:937) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) ~[main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) ~[main/:?] 1> ... 3 more 1> [2022-01-15T16:47:43,489][WARN ][o.o.t.OutboundHandler ] [node_t2] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:60486, remoteAddress=127.0.0.1/127.0.0.1:45001}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport$NodeChannels.sendRequest(TcpTransport.java:309) [main/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:248) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) [main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler.handleWakeUp(LeaderChecker.java:261) [main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler$3.run(LeaderChecker.java:370) [main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [main/:?] 1> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] 1> at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] 1> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T16:47:43,545][WARN ][o.o.t.OutboundHandler ] [node_t0] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:60334, remoteAddress=127.0.0.1/127.0.0.1:45001}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport$NodeChannels.sendRequest(TcpTransport.java:309) [main/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:248) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) [main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler.handleWakeUp(LeaderChecker.java:261) [main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler$3.run(LeaderChecker.java:370) [main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [main/:?] 1> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] 1> at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] 1> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T09:47:43,656][WARN ][o.o.t.OutboundHandler ] [node_t1] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:37760, remoteAddress=127.0.0.1/127.0.0.1:42923}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport.lambda$new$1(TcpTransport.java:188) [main/:?] 1> at org.opensearch.transport.TransportHandshaker.sendHandshake(TransportHandshaker.java:98) [main/:?] 1> at org.opensearch.transport.TcpTransport.executeHandshake(TcpTransport.java:889) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1035) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1008) [main/:?] 1> at org.opensearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:211) [main/:?] 1> at org.opensearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:52) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863) [?:?] 1> at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841) [?:?] 1> at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) [?:?] 1> at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147) [?:?] 1> at org.opensearch.common.concurrent.CompletableContext.complete(CompletableContext.java:74) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.SocketChannelContext.connect(SocketChannelContext.java:165) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.EventHandler.handleConnect(EventHandler.java:130) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.nio.TestEventHandler.handleConnect(TestEventHandler.java:139) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.attemptConnect(NioSelector.java:446) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.registerChannel(NioSelector.java:469) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.setUpNewChannels(NioSelector.java:458) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.preSelect(NioSelector.java:279) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:172) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T16:47:44,491][WARN ][o.o.t.OutboundHandler ] [node_t2] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:60488, remoteAddress=127.0.0.1/127.0.0.1:45001}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport$NodeChannels.sendRequest(TcpTransport.java:309) [main/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:248) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) [main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler.handleWakeUp(LeaderChecker.java:261) [main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler$3.run(LeaderChecker.java:370) [main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [main/:?] 1> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] 1> at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] 1> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T16:47:44,547][WARN ][o.o.t.OutboundHandler ] [node_t0] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:60340, remoteAddress=127.0.0.1/127.0.0.1:45001}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport$NodeChannels.sendRequest(TcpTransport.java:309) [main/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:248) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) [main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler.handleWakeUp(LeaderChecker.java:261) [main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler$3.run(LeaderChecker.java:370) [main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [main/:?] 1> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] 1> at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] 1> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T09:47:44,656][WARN ][o.o.t.OutboundHandler ] [node_t1] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:37762, remoteAddress=127.0.0.1/127.0.0.1:42923}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport.lambda$new$1(TcpTransport.java:188) [main/:?] 1> at org.opensearch.transport.TransportHandshaker.sendHandshake(TransportHandshaker.java:98) [main/:?] 1> at org.opensearch.transport.TcpTransport.executeHandshake(TcpTransport.java:889) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1035) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1008) [main/:?] 1> at org.opensearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:211) [main/:?] 1> at org.opensearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:52) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863) [?:?] 1> at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841) [?:?] 1> at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) [?:?] 1> at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147) [?:?] 1> at org.opensearch.common.concurrent.CompletableContext.complete(CompletableContext.java:74) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.SocketChannelContext.connect(SocketChannelContext.java:165) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.EventHandler.handleConnect(EventHandler.java:130) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.nio.TestEventHandler.handleConnect(TestEventHandler.java:139) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.attemptConnect(NioSelector.java:446) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.registerChannel(NioSelector.java:469) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.setUpNewChannels(NioSelector.java:458) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.preSelect(NioSelector.java:279) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:172) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T16:47:45,492][WARN ][o.o.t.OutboundHandler ] [node_t2] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:60484, remoteAddress=127.0.0.1/127.0.0.1:45001}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport$NodeChannels.sendRequest(TcpTransport.java:309) [main/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:248) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) [main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler.handleWakeUp(LeaderChecker.java:261) [main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler$3.run(LeaderChecker.java:370) [main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [main/:?] 1> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] 1> at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] 1> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T16:47:45,493][INFO ][o.o.c.c.Coordinator ] [node_t2] master node [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}] failed, restarting discovery 1> org.opensearch.OpenSearchException: node [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}] failed [3] consecutive checks 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:314) ~[main/:?] 1> at org.opensearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1350) ~[main/:?] 1> at org.opensearch.transport.TransportService$7.doRun(TransportService.java:910) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) ~[main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) ~[main/:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> Caused by: org.opensearch.transport.SendRequestTransportException: [node_t1][127.0.0.1:45001][internal:coordination/fault_detection/leader_check] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:882) ~[main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) ~[main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) ~[main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler.handleWakeUp(LeaderChecker.java:261) ~[main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler$3.run(LeaderChecker.java:370) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [main/:?] 1> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) ~[?:?] 1> at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?] 1> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?] 1> ... 3 more 1> Caused by: java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) ~[main/:?] 1> at org.opensearch.transport.TcpTransport$NodeChannels.sendRequest(TcpTransport.java:309) ~[main/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:248) ~[framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) ~[main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) ~[main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) ~[main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler.handleWakeUp(LeaderChecker.java:261) ~[main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler$3.run(LeaderChecker.java:370) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) ~[main/:?] 1> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) ~[?:?] 1> at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?] 1> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?] 1> ... 3 more 1> [2022-01-15T09:47:45,496][INFO ][o.o.c.s.ClusterApplierService] [node_t2] master node changed {previous [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}], current []}, term: 2, version: 18, reason: becoming candidate: onLeaderFailure 1> [2022-01-15T16:47:45,496][WARN ][o.o.t.OutboundHandler ] [node_t2] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:37764, remoteAddress=127.0.0.1/127.0.0.1:42923}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport.lambda$new$1(TcpTransport.java:188) [main/:?] 1> at org.opensearch.transport.TransportHandshaker.sendHandshake(TransportHandshaker.java:98) [main/:?] 1> at org.opensearch.transport.TcpTransport.executeHandshake(TcpTransport.java:889) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1035) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1008) [main/:?] 1> at org.opensearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:211) [main/:?] 1> at org.opensearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:52) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863) [?:?] 1> at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841) [?:?] 1> at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) [?:?] 1> at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147) [?:?] 1> at org.opensearch.common.concurrent.CompletableContext.complete(CompletableContext.java:74) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.SocketChannelContext.connect(SocketChannelContext.java:165) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.EventHandler.handleConnect(EventHandler.java:130) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.nio.TestEventHandler.handleConnect(TestEventHandler.java:139) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.attemptConnect(NioSelector.java:446) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.registerChannel(NioSelector.java:469) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.setUpNewChannels(NioSelector.java:458) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.preSelect(NioSelector.java:279) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:172) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T16:47:45,496][WARN ][o.o.t.OutboundHandler ] [node_t2] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:41784, remoteAddress=127.0.0.1/127.0.0.1:45001}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport.lambda$new$1(TcpTransport.java:188) [main/:?] 1> at org.opensearch.transport.TransportHandshaker.sendHandshake(TransportHandshaker.java:98) [main/:?] 1> at org.opensearch.transport.TcpTransport.executeHandshake(TcpTransport.java:889) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1035) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1008) [main/:?] 1> at org.opensearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:211) [main/:?] 1> at org.opensearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:52) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863) [?:?] 1> at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841) [?:?] 1> at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) [?:?] 1> at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147) [?:?] 1> at org.opensearch.common.concurrent.CompletableContext.complete(CompletableContext.java:74) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.SocketChannelContext.connect(SocketChannelContext.java:165) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.EventHandler.handleConnect(EventHandler.java:130) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.nio.TestEventHandler.handleConnect(TestEventHandler.java:139) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.attemptConnect(NioSelector.java:446) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.registerChannel(NioSelector.java:469) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.setUpNewChannels(NioSelector.java:458) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.preSelect(NioSelector.java:279) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:172) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T16:47:45,548][WARN ][o.o.t.OutboundHandler ] [node_t0] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:60336, remoteAddress=127.0.0.1/127.0.0.1:45001}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport$NodeChannels.sendRequest(TcpTransport.java:309) [main/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:248) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) [main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) [main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler.handleWakeUp(LeaderChecker.java:261) [main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler$3.run(LeaderChecker.java:370) [main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [main/:?] 1> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] 1> at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] 1> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T16:47:45,549][INFO ][o.o.c.c.Coordinator ] [node_t0] master node [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}] failed, restarting discovery 1> org.opensearch.OpenSearchException: node [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}] failed [3] consecutive checks 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:314) ~[main/:?] 1> at org.opensearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1350) ~[main/:?] 1> at org.opensearch.transport.TransportService$7.doRun(TransportService.java:910) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:792) ~[main/:?] 1> at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:50) ~[main/:?] 1> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] 1> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> Caused by: org.opensearch.transport.SendRequestTransportException: [node_t1][127.0.0.1:45001][internal:coordination/fault_detection/leader_check] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:882) ~[main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) ~[main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) ~[main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler.handleWakeUp(LeaderChecker.java:261) ~[main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler$3.run(LeaderChecker.java:370) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) [main/:?] 1> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) ~[?:?] 1> at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?] 1> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?] 1> ... 3 more 1> Caused by: java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) ~[main/:?] 1> at org.opensearch.transport.TcpTransport$NodeChannels.sendRequest(TcpTransport.java:309) ~[main/:?] 1> at org.opensearch.test.transport.StubbableTransport$WrappedConnection.sendRequest(StubbableTransport.java:248) ~[framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.TransportService.sendRequestInternal(TransportService.java:869) ~[main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:756) ~[main/:?] 1> at org.opensearch.transport.TransportService.sendRequest(TransportService.java:700) ~[main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler.handleWakeUp(LeaderChecker.java:261) ~[main/:?] 1> at org.opensearch.cluster.coordination.LeaderChecker$CheckScheduler$3.run(LeaderChecker.java:370) ~[main/:?] 1> at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:733) ~[main/:?] 1> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) ~[?:?] 1> at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?] 1> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?] 1> ... 3 more 1> [2022-01-15T09:47:45,550][INFO ][o.o.c.s.ClusterApplierService] [node_t0] master node changed {previous [{node_t1}{UnDoZ4G8SQOOwTd1w6R1dg}{t05zwrLvSaywY5Mq26rLWA}{127.0.0.1}{127.0.0.1:45001}{dimr}{shard_indexing_pressure_enabled=true}], current []}, term: 2, version: 18, reason: becoming candidate: onLeaderFailure 1> [2022-01-15T09:47:45,550][WARN ][o.o.t.OutboundHandler ] [node_t0] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:41786, remoteAddress=127.0.0.1/127.0.0.1:45001}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport.lambda$new$1(TcpTransport.java:188) [main/:?] 1> at org.opensearch.transport.TransportHandshaker.sendHandshake(TransportHandshaker.java:98) [main/:?] 1> at org.opensearch.transport.TcpTransport.executeHandshake(TcpTransport.java:889) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1035) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1008) [main/:?] 1> at org.opensearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:211) [main/:?] 1> at org.opensearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:52) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863) [?:?] 1> at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841) [?:?] 1> at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) [?:?] 1> at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147) [?:?] 1> at org.opensearch.common.concurrent.CompletableContext.complete(CompletableContext.java:74) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.SocketChannelContext.connect(SocketChannelContext.java:165) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.EventHandler.handleConnect(EventHandler.java:130) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.nio.TestEventHandler.handleConnect(TestEventHandler.java:139) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.attemptConnect(NioSelector.java:446) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.registerChannel(NioSelector.java:469) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.setUpNewChannels(NioSelector.java:458) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.preSelect(NioSelector.java:279) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:172) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T09:47:45,552][WARN ][o.o.t.OutboundHandler ] [node_t0] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:41788, remoteAddress=/127.0.0.1:45001}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport.lambda$new$1(TcpTransport.java:188) [main/:?] 1> at org.opensearch.transport.TransportHandshaker.sendHandshake(TransportHandshaker.java:98) [main/:?] 1> at org.opensearch.transport.TcpTransport.executeHandshake(TcpTransport.java:889) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1035) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1008) [main/:?] 1> at org.opensearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:211) [main/:?] 1> at org.opensearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:52) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863) [?:?] 1> at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841) [?:?] 1> at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) [?:?] 1> at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147) [?:?] 1> at org.opensearch.common.concurrent.CompletableContext.complete(CompletableContext.java:74) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.SocketChannelContext.connect(SocketChannelContext.java:165) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.EventHandler.handleConnect(EventHandler.java:130) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.nio.TestEventHandler.handleConnect(TestEventHandler.java:139) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.attemptConnect(NioSelector.java:446) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.registerChannel(NioSelector.java:469) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.setUpNewChannels(NioSelector.java:458) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.preSelect(NioSelector.java:279) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:172) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 1> [2022-01-15T09:47:45,656][WARN ][o.o.t.OutboundHandler ] [node_t1] send message failed [channel: NioSocketChannel{localAddress=/127.0.0.1:37772, remoteAddress=127.0.0.1/127.0.0.1:42923}] 1> java.lang.RuntimeException: The rule is not currently executing. 1> at org.apache.lucene.util.TestRuleStoreClassName.getTestClass(TestRuleStoreClassName.java:55) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.apache.lucene.util.LuceneTestCase.getTestClass(LuceneTestCase.java:791) ~[lucene-test-framework-8.10.1.jar:8.10.1 2f24e6a49d48a032df1f12e146612f59141727a9 - mayyasharipova - 2021-10-12 15:13:08] 1> at org.opensearch.common.util.MockPageCacheRecycler.wrap(MockPageCacheRecycler.java:89) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.MockPageCacheRecycler.bytePage(MockPageCacheRecycler.java:138) ~[framework-2.0.0-SNAPSHOT.jar:?] 1> at org.opensearch.common.util.BigArrays.newByteArray(BigArrays.java:495) ~[main/:?] 1> at org.opensearch.common.io.stream.BytesStreamOutput.(BytesStreamOutput.java:80) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:57) ~[main/:?] 1> at org.opensearch.common.io.stream.ReleasableBytesStreamOutput.(ReleasableBytesStreamOutput.java:53) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:223) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$MessageSerializer.get(OutboundHandler.java:210) ~[main/:?] 1> at org.opensearch.transport.OutboundHandler$SendContext.get(OutboundHandler.java:264) [main/:?] 1> at org.opensearch.transport.OutboundHandler.internalSend(OutboundHandler.java:191) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendMessage(OutboundHandler.java:186) [main/:?] 1> at org.opensearch.transport.OutboundHandler.sendRequest(OutboundHandler.java:123) [main/:?] 1> at org.opensearch.transport.TcpTransport.lambda$new$1(TcpTransport.java:188) [main/:?] 1> at org.opensearch.transport.TransportHandshaker.sendHandshake(TransportHandshaker.java:98) [main/:?] 1> at org.opensearch.transport.TcpTransport.executeHandshake(TcpTransport.java:889) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1035) [main/:?] 1> at org.opensearch.transport.TcpTransport$ChannelsConnectedListener.onResponse(TcpTransport.java:1008) [main/:?] 1> at org.opensearch.action.ActionListener.lambda$toBiConsumer$2(ActionListener.java:211) [main/:?] 1> at org.opensearch.common.concurrent.CompletableContext.lambda$addListener$0(CompletableContext.java:52) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863) [?:?] 1> at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841) [?:?] 1> at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510) [?:?] 1> at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147) [?:?] 1> at org.opensearch.common.concurrent.CompletableContext.complete(CompletableContext.java:74) [opensearch-core-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.SocketChannelContext.connect(SocketChannelContext.java:165) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.EventHandler.handleConnect(EventHandler.java:130) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.transport.nio.TestEventHandler.handleConnect(TestEventHandler.java:139) [framework-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.attemptConnect(NioSelector.java:446) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.registerChannel(NioSelector.java:469) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.setUpNewChannels(NioSelector.java:458) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.preSelect(NioSelector.java:279) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:172) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) [opensearch-nio-2.0.0-SNAPSHOT.jar:2.0.0-SNAPSHOT] 1> at java.lang.Thread.run(Thread.java:833) [?:?] 2> Jan 15, 2022 4:47:45 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll 2> SEVERE: There are still zombie threads that couldn't be terminated: 2> 1) Thread[id=329, name=opensearch[node_t0][scheduler][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1672) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 2) Thread[id=354, name=opensearch[node_t1][generic][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 3) Thread[id=366, name=opensearch[node_t1][DanglingIndices#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 4) Thread[id=367, name=opensearch[node_t0][DanglingIndices#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 5) Thread[id=370, name=opensearch[node_t0][write][T#2], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 6) Thread[id=359, name=opensearch[node_t1][generic][T#2], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 7) Thread[id=335, name=opensearch[node_t2][transport_worker][T#1], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/java.lang.Thread.holdsLock(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:103) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(S 2> electorImpl.java:129) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 8) Thread[id=327, name=opensearch[node_t2][scheduler][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1672) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 9) Thread[id=347, name=opensearch[node_t0][generic][T#2], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 10) Thread[id=375, name=opensearch[node_t0][flush][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 11) Thread[id=344, name=opensearch[node_t2][generic][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 12) Thread[id=336, name=opensearch[node_t1][transport_worker][T#1], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/sun.nio.ch.EventFD.set0(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EventFD.set(EventFD.java:48) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:251) 2> at java.base@17.0.1/java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:230) 2> at java.base@17.0.1/java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:236) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.begin(SelectorImpl.java:99) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:114) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 13) Thread[id=346, name=opensearch[node_t2][clusterApplierService#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:535) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 14) Thread[id=338, name=opensearch[node_t2][transport_worker][T#2], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/sun.nio.ch.EventFD.set0(Native Method) 2> at java.ba 2> se@17.0.1/sun.nio.ch.EventFD.set(EventFD.java:48) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:251) 2> at java.base@17.0.1/java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:230) 2> at java.base@17.0.1/java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:236) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.begin(SelectorImpl.java:99) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:114) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 15) Thread[id=337, name=opensearch[node_t0][transport_worker][T#1], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/sun.nio.ch.EventFD.set0(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EventFD.set(EventFD.java:48) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:251) 2> at java.base@17.0.1/java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:230) 2> at java.base@17.0.1/java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:236) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.begin(SelectorImpl.java:99) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:114) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 16) Thread[id=374, name=opensearch[node_t0][management][T#2], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 17) Thread[id=372, name=opensearch[node_t0][refresh][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 18) Thread[id=342, name=opensearch[node_t0][clusterApplierService#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:535) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 19) Thread[id=351, name=opensearch[node_t2][generic][T#3], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 20) Thread[id=340, name=opensearch[node_t0][transport_worker][T#2], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/java.lang.Thread.holdsLock(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:103) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 21) Thread[id=365, name=opensearch[node_t0][management][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java 2> .util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 22) Thread[id=341, name=opensearch[node_t0][generic][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 23) Thread[id=363, name=opensearch[node_t1][management][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 24) Thread[id=364, name=opensearch[node_t1][management][T#2], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 25) Thread[id=352, name=opensearch[node_t2][generic][T#4], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 26) Thread[id=376, name=opensearch[node_t1][flush][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 27) Thread[id=339, name=opensearch[node_t1][transport_worker][T#2], state=RUNNABLE, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/java.lang.Thread.holdsLock(Native Method) 2> at java.base@17.0.1/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:103) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:129) 2> at java.base@17.0.1/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) 2> at app//org.opensearch.nio.NioSelector.singleLoop(NioSelector.java:181) 2> at app//org.opensearch.nio.NioSelector.runLoop(NioSelector.java:148) 2> at app//org.opensearch.nio.NioSelectorGroup$$Lambda$2228/0x0000000801247528.run(Unknown Source) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 28) Thread[id=331, name=opensearch[node_t1][scheduler][T#1], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1672) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182) 2> at java.base@17.0.1/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThrea 2> dPoolExecutor.java:899) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 29) Thread[id=361, name=opensearch[node_t1][generic][T#4], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 30) Thread[id=356, name=opensearch[node_t1][clusterApplierService#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:535) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 31) Thread[id=368, name=opensearch[node_t1][write][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 32) Thread[id=355, name=opensearch[node_t0][generic][T#4], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 33) Thread[id=371, name=opensearch[node_t1][refresh][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 34) Thread[id=362, name=opensearch[node_t1][masterService#updateTask][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2> at java.base@17.0.1/java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:535) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:8 2> 33) 2> 35) Thread[id=373, name=opensearch[node_t1][management][T#3], state=TIMED_WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:252) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:676) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.poll(LinkedTransferQueue.java:1294) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1061) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 36) Thread[id=350, name=opensearch[node_t2][generic][T#2], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 37) Thread[id=369, name=opensearch[node_t0][write][T#1], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 38) Thread[id=360, name=opensearch[node_t1][generic][T#3], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> 39) Thread[id=353, name=opensearch[node_t0][generic][T#3], state=WAITING, group=TGRP-ShardIndexingPressureSettingsIT] 2> at java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2> at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue$Node.block(LinkedTransferQueue.java:470) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2> at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.awaitMatch(LinkedTransferQueue.java:669) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.xfer(LinkedTransferQueue.java:616) 2> at java.base@17.0.1/java.util.concurrent.LinkedTransferQueue.take(LinkedTransferQueue.java:1286) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1062) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1122) 2> at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2> at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2> java.lang.Exception: Suite timeout exceeded (>= 600000 msec). at __randomizedtesting.SeedInfo.seed([589B15FA746087E9]:0) 2> REPRODUCE WITH: ./gradlew ':server:internalClusterTest' --tests "org.opensearch.index.ShardIndexingPressureSettingsIT" -Dtests.seed=589B15FA746087E9 -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=en -Dtests.timezone=Etc/UTC -Druntime.java=17 2> NOTE: test params are: codec=Asserting(Lucene87), sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=zh-HK, timezone=US/Mountain 2> NOTE: Linux 5.11.0-1022-aws amd64/Eclipse Adoptium 17.0.1 (64-bit)/cpus=72,threads=46,free=380624384,total=536870912 2> NOTE: All tests run in this JVM: [ClearIndicesCacheBlocksIT, IndexAliasesIT, ClusterServiceIT, ShardIndexingPressureSettingsIT] Tests with failures: - org.opensearch.index.ShardIndexingPressureSettingsIT.testShardIndexingPressureEnforcedEnabledDisabledSetting - org.opensearch.index.ShardIndexingPressureSettingsIT.classMethod 2605 tests completed, 2 failed, 56 skipped > Task :server:internalClusterTest FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':server:internalClusterTest'. > There were failing tests. See the report at: file:///home/ubuntu/os/OpenSearch/server/build/reports/tests/internalClusterTest/index.html * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 13m 50s 242 actionable tasks: 22 executed, 220 up-to-date