[ES Snapshot Promotion failure] endpoint When on the Endpoint Policy Details Page when on Ingest Configurations Edit Package Config page "before each" hook for "should show a link to Policy Details"

[spalger]

This test has failed 4 PRs in the last week and just failed an ES Snapshot Promotion job. I'm skipping it so that the endpoint folks can take a look at it.

ES Snapshot Promotion failure

Stack trace:

Error: expected testSubject(editPackageConfig_header) to exist
    at TestSubjects.existOrFail (/dev/shm/workspace/kibana/test/functional/services/common/test_subjects.ts:62:15)

Screenshot:

Skipped

master: 4ec6a71
7.x/7.10: 7037f8e
7.9: 47c2b2b

[elasticmachine]

Pinging @elastic/endpoint-app-team (Feature:Endpoint)

[elasticmachine]

Pinging @elastic/endpoint-management (Team:Endpoint Management)

[elasticmachine]

Pinging @elastic/ingest-management (Team:ingest-management)

[paul-tavares]

Fixed with #72149

[spalger]

This is an issue again, we got a little backlogged and this had been failing for about 6 days: https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/1459/

Skip these tests again to allow the snapshot to update.

master: 0f6c35c
7.x/7.10: 1ff605f

[kevinlog]

@nnamdifrankie we're getting the same error here that we're seeing due to the template bug.

We'll be able to resolve this when we fix this: #78024

In the meantime, we should publish a package that doesn't use the transform to prevent any more downstream effects until the fix is in. elastic/endpoint-package#84
FYI @jonathan-buttner @nnamdifrankie unless we can fix the root bug quick, may need help publishing the above tomorrow

Error from failing test below https://kibana-ci.elastic.co/job/elasticsearch+snapshots+verify/1459/testReport/

[00:00:06]             │ proc [kibana]   log   [20:52:46.074] [error][ingestManager][plugins] { Error: [runtime_exception] Could not create destination index [metrics-endpoint.metadata_current-default] for transform [metrics-endpoint.metadata-current-default-0.16.0-dev.0]
[00:00:06]             │ proc [kibana]     at respond (/dev/shm/workspace/kibana/build/kibana-build-xpack-7/node_modules/elasticsearch/src/lib/transport.js:349:15)
[00:00:06]             │ proc [kibana]     at checkRespForFailure (/dev/shm/workspace/kibana/build/kibana-build-xpack-7/node_modules/elasticsearch/src/lib/transport.js:306:7)
[00:00:06]             │ proc [kibana]     at HttpConnector.<anonymous> (/dev/shm/workspace/kibana/build/kibana-build-xpack-7/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
[00:00:06]             │ proc [kibana]     at IncomingMessage.wrapper (/dev/shm/workspace/kibana/build/kibana-build-xpack-7/node_modules/lodash/lodash.js:4949:19)
[00:00:06]             │ proc [kibana]     at IncomingMessage.emit (events.js:203:15)
[00:00:06]             │ proc [kibana]     at endReadableNT (_stream_readable.js:1145:12)
[00:00:06]             │ proc [kibana]     at process._tickCallback (internal/process/next_tick.js:63:19)
[00:00:06]             │ proc [kibana]   status: 500,
[00:00:06]             │ proc [kibana]   displayName: 'InternalServerError',
[00:00:06]             │ proc [kibana]   message:
[00:00:06]             │ proc [kibana]    '[runtime_exception] Could not create destination index [metrics-endpoint.metadata_current-default] for transform [metrics-endpoint.metadata-current-default-0.16.0-dev.0]',
[00:00:06]             │ proc [kibana]   path:
[00:00:06]             │ proc [kibana]    '/_transform/metrics-endpoint.metadata-current-default-0.16.0-dev.0/_start',
[00:00:06]             │ proc [kibana]   query: undefined,
[00:00:06]             │ proc [kibana]   body:
[00:00:06]             │ proc [kibana]    { error:
[00:00:06]             │ proc [kibana]       { root_cause: [Array],
[00:00:06]             │ proc [kibana]         type: 'runtime_exception',
[00:00:06]             │ proc [kibana]         reason:
[00:00:06]             │ proc [kibana]          'Could not create destination index [metrics-endpoint.metadata_current-default] for transform [metrics-endpoint.metadata-current-default-0.16.0-dev.0]',
[00:00:06]             │ proc [kibana]         caused_by: [Object] },
[00:00:06]             │ proc [kibana]      status: 500 },
[00:00:06]             │ proc [kibana]   statusCode: 500,
[00:00:06]             │ proc [kibana]   response:
[00:00:06]             │ proc [kibana]    '{"error":{"root_cause":[{"type":"runtime_exception","reason":"Could not create destination index [metrics-endpoint.metadata_current-default] for transform [metrics-endpoint.metadata-current-default-0.16.0-dev.0]"}],"type":"runtime_exception","reason":"Could not create destination index [metrics-endpoint.metadata_current-default] for transform [metrics-endpoint.metadata-current-default-0.16.0-dev.0]","caused_by":{"type":"illegal_argument_exception","reason":"cannot create index with name [metrics-endpoint.metadata_current-default], because it matches with template [metrics-endpoint.metadata_current] that creates data streams only, use create data stream api instead"}},"status":500}',
[00:00:06]             │ proc [kibana]   toString: [Function],
[00:00:06]             │ proc [kibana]   toJSON: [Function] }
[00:00:06]             │ proc [kibana]   log   [20:52:46.086] [error][ingestManager][plugins] { Error: [runtime_exception] Could not create destination index [metrics-endpoint.metadata_current-default] for transform [metrics-endpoint.metadata-current-default-0.16.0-dev.0]
[00:00:06]             │ proc [kibana]     at respond (/dev/shm/workspace/kibana/build/kibana-build-xpack-7/node_modules/elasticsearch/src/lib/transport.js:349:15)
[00:00:06]             │ proc [kibana]     at checkRespForFailure (/dev/shm/workspace/kibana/build/kibana-build-xpack-7/node_modules/elasticsearch/src/lib/transport.js:306:7)
[00:00:06]             │ proc [kibana]     at HttpConnector.<anonymous> (/dev/shm/workspace/kibana/build/kibana-build-xpack-7/node_modules/elasticsearch/src/lib/connectors/http.js:173:7)
[00:00:06]             │ proc [kibana]     at IncomingMessage.wrapper (/dev/shm/workspace/kibana/build/kibana-build-xpack-7/node_modules/lodash/lodash.js:4949:19)
[00:00:06]             │ proc [kibana]     at IncomingMessage.emit (events.js:203:15)
[00:00:06]             │ proc [kibana]     at endReadableNT (_stream_readable.js:1145:12)
[00:00:06]             │ proc [kibana]     at process._tickCallback (internal/process/next_tick.js:63:19)
[00:00:06]             │ proc [kibana]   status: 500,
[00:00:06]             │ proc [kibana]   displayName: 'InternalServerError',
[00:00:06]             │ proc [kibana]   message:
[00:00:06]             │ proc [kibana]    '[runtime_exception] Could not create destination index [metrics-endpoint.metadata_current-default] for transform [metrics-endpoint.metadata-current-default-0.16.0-dev.0]',
[00:00:06]             │ proc [kibana]   path:
[00:00:06]             │ proc [kibana]    '/_transform/metrics-endpoint.metadata-current-default-0.16.0-dev.0/_start',
[00:00:06]             │ proc [kibana]   query: undefined,
[00:00:06]             │ proc [kibana]   body:
[00:00:06]             │ proc [kibana]    { error:
[00:00:06]             │ proc [kibana]       { root_cause: [Array],
[00:00:06]             │ proc [kibana]         type: 'runtime_exception',
[00:00:06]             │ proc [kibana]         reason:
[00:00:06]             │ proc [kibana]          'Could not create destination index [metrics-endpoint.metadata_current-default] for transform [metrics-endpoint.metadata-current-default-0.16.0-dev.0]',
[00:00:06]             │ proc [kibana]         caused_by: [Object] },
[00:00:06]             │ proc [kibana]      status: 500 },
[00:00:06]             │ proc [kibana]   statusCode: 500,
[00:00:06]             │ proc [kibana]   response:
[00:00:06]             │ proc [kibana]    '{"error":{"root_cause":[{"type":"runtime_exception","reason":"Could not create destination index [metrics-endpoint.metadata_current-default] for transform [metrics-endpoint.metadata-current-default-0.16.0-dev.0]"}],"type":"runtime_exception","reason":"Could not create destination index [metrics-endpoint.metadata_current-default] for transform [metrics-endpoint.metadata-current-default-0.16.0-dev.0]","caused_by":{"type":"illegal_argument_exception","reason":"cannot create index with name [metrics-endpoint.metadata_current-default], because it matches with template [metrics-endpoint.metadata_current] that creates data streams only, use create data stream api instead"}},"status":500}',

[spalger]

I'm going to use this issue track the general incompatibility between the endpoint stuff and the newest snapshot, closing #78223.

I've submitted #78366 which includes the skips from #78194 and a new one, along with the env changes to actually test the skips against the newest snapshot so we can verify that these skips will actually allow us to promote the new snapshot.