Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/spaces/spaces_selection·ts - Spaces app Spaces Space Selector allows user to navigate to different spaces #99581

Closed
kibanamachine opened this issue May 8, 2021 · 17 comments · Fixed by #117372 or #131905
Closed

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/spaces/spaces_selection·ts - Spaces app Spaces Space Selector allows user to navigate to different spaces #99581

kibanamachine opened this issue May 8, 2021 · 17 comments · Fixed by #117372 or #131905
Assignees
@legrego
Labels
failed-test A test failure on a tracked branch, potentially flaky-test impact:critical This issue should be addressed immediately due to a critical level of impact on the product. loe:small Small Level of Effort Team:Security Team focused on: Auth, Users, Roles, Spaces, Audit Logging, and more!

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented May 8, 2021 •
edited
Loading

A test failed on a tracked branch

Error: retry.try timeout: Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="space-avatar-default"])
Wait timed out after 10026ms
    at /dev/shm/workspace/parallel/3/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:93:5)
    at onFailure (/dev/shm/workspace/parallel/3/kibana/test/common/services/retry/retry_for_success.ts:17:9)
    at retryForSuccess (/dev/shm/workspace/parallel/3/kibana/test/common/services/retry/retry_for_success.ts:57:13)
    at Retry.try (/dev/shm/workspace/parallel/3/kibana/test/common/services/retry/retry.ts:32:14)
    at Proxy.clickByCssSelector (/dev/shm/workspace/parallel/3/kibana/test/functional/services/common/find.ts:420:7)
    at TestSubjects.click (/dev/shm/workspace/parallel/3/kibana/test/functional/services/common/test_subjects.ts:109:7)
    at /dev/shm/workspace/parallel/3/kibana/x-pack/test/functional/page_objects/space_selector_page.ts:193:9
    at runAttempt (/dev/shm/workspace/parallel/3/kibana/test/common/services/retry/retry_for_success.ts:27:15)
    at retryForSuccess (/dev/shm/workspace/parallel/3/kibana/test/common/services/retry/retry_for_success.ts:66:21)
    at Retry.try (/dev/shm/workspace/parallel/3/kibana/test/common/services/retry/retry.ts:32:14)
    at SpaceSelectorPage.clickSpaceAvatar (test/functional/page_objects/space_selector_page.ts:191:14)
    at Context.<anonymous> (test/functional/apps/spaces/spaces_selection.ts:53:9)
    at Object.apply (/dev/shm/workspace/parallel/3/kibana/node_modules/@kbn/test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
    at onFailure (/dev/shm/workspace/parallel/3/kibana/test/common/services/retry/retry_for_success.ts:17:9)
    at retryForSuccess (/dev/shm/workspace/parallel/3/kibana/test/common/services/retry/retry_for_success.ts:57:13)
    at Retry.try (/dev/shm/workspace/parallel/3/kibana/test/common/services/retry/retry.ts:32:14)
    at SpaceSelectorPage.clickSpaceAvatar (test/functional/page_objects/space_selector_page.ts:191:14)
    at Context.<anonymous> (test/functional/apps/spaces/spaces_selection.ts:53:9)
    at Object.apply (/dev/shm/workspace/parallel/3/kibana/node_modules/@kbn/test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)

First failure: Jenkins Build
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label May 8, 2021
@botelastic botelastic bot added the needs-team Issues missing a team label label May 8, 2021
@mistic mistic added the Team:Security Team focused on: Auth, Users, Roles, Spaces, Audit Logging, and more! label May 10, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-security (Team:Security)

@botelastic botelastic bot removed the needs-team Issues missing a team label label May 10, 2021
@legrego
Copy link
Member

legrego commented May 10, 2021

Based on the screenshot, it looks like the Spaces Nav failed to open?

image

@legrego legrego mentioned this issue May 12, 2021
Closed
@legrego
Copy link
Member

legrego commented May 12, 2021

Related failure #99879

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

spalger added a commit that referenced this issue May 19, 2021
@spalger
skip flaky suite (#99581)
4b0c01a
spalger added a commit that referenced this issue May 19, 2021
@spalger
skip flaky suite (#99581)
c6639e2 
(cherry picked from commit 4b0c01a)
spalger added a commit that referenced this issue May 19, 2021
@spalger
skip flaky suite (#99581)
87fe5fa 
(cherry picked from commit 4b0c01a)
@spalger
Copy link
Contributor

spalger commented May 19, 2021

4 PR failures (all against master) and one failure on 7.13 in the last week, not a ton of flakiness but since there are similar failures I'm going to skip this suite assuming this is a race condition we would hopefully fix all the way back to 7.13

image

master/8.0: 4b0c01a
7.x/7.14: c6639e2
7.13: 87fe5fa

@spalger spalger added blocker release_note:skip Skip the PR/issue when compiling release notes skipped-test v7.13.1 and removed release_note:skip Skip the PR/issue when compiling release notes labels May 19, 2021
yctercero pushed a commit to yctercero/kibana that referenced this issue May 25, 2021
@spalger @yctercero
skip flaky suite (elastic#99581)
2b07209
@legrego legrego self-assigned this May 25, 2021
@legrego legrego mentioned this issue May 25, 2021
Merged
@kibanamachine kibanamachine reopened this May 30, 2021
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

spalger added a commit that referenced this issue Jun 3, 2021
@spalger
skip flaky suite (#99581)
f5df40a
spalger added a commit that referenced this issue Jun 3, 2021
@spalger
skip flaky suite (#99581)
f054e5d 
(cherry picked from commit f5df40a)
@spalger
Copy link
Contributor

spalger commented Jun 3, 2021

image

7 failures on master and PRs since this was fixed. Skipping again @legrego

master/8.0: f5df40a
7.x/7.14: f054e5d

@spalger spalger added v7.14.0 and removed v7.13.1 labels Jun 3, 2021
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.0

mistic added a commit that referenced this issue Nov 16, 2021
@mistic
skip flaky suites (#99581, #118356, #118474)
b3d58a4
mistic added a commit that referenced this issue Nov 16, 2021
@mistic
skip flaky suites (#99581, #118356, #118474)
461df84
mistic added a commit that referenced this issue Nov 16, 2021
@mistic
skip flaky suites (#99581, #118356, #118474)
e724902
@mistic
Copy link
Member

mistic commented Nov 16, 2021

This test keeps failing and looks flaky. Skipping for now.

main/8.1: b3d58a4
8.0: 461df84
7.16: e724902

jloleysens added a commit to jloleysens/kibana that referenced this issue Nov 16, 2021
@jloleysens
Merge branch 'main' of github.com:elastic/kibana into reporting/poc-m…
0808a04 
…igrate-away-from-injected-css-js

* 'main' of github.com:elastic/kibana: (221 commits)
  [Reporting] Add log level to config (elastic#118319)
  [Metrics UI] Skip failing waffle chart color palette test (elastic#118527)
  [APM] chore: Unify naming of 'apm/scripts/**/*' with snake_case (elastic#118328)
  skip flaky suites (elastic#99581, elastic#118356, elastic#118474)
  [Alerting] Initial implementation of alerting task `cancel()` (elastic#114289)
  chore(NA): creates pkg_npm_types bazel rule (elastic#116465)
  skip flaky suite (elastic#116892)
  Bump chromedriver to 95.0.0 (elastic#116724)
  [Data visualizer] Improve design of expanded rows (elastic#118125)
  [APM] prefer ECS field names for HTTP and URL (elastic#118485)
  Update query_debugging_in_development_and_production.md (elastic#118491)
  [Uptime] adjust Elastic Synthetics integration functional tests (elastic#118163)
  [kbn/rule-data-utils] add submodules and require public use them (elastic#117963)
  [DOCS] Refresh APM correlation screenshots (elastic#116723) (elastic#118577)
  Handles ns to ms conversion for event loop delay metrics (elastic#118447)
  [Cases] Rename functional tests folder (elastic#118490)
  dummy commit
  skip flaky suite (elastic#118593)
  Improve workpad schema validation (elastic#97838)
  skip flaky suite (elastic#118584)
  ...

# Conflicts:
#	src/plugins/dashboard/public/application/embeddable/viewport/dashboard_viewport.tsx
fkanout pushed a commit to fkanout/kibana that referenced this issue Nov 17, 2021
@mistic @fkanout
skip flaky suites (elastic#99581, elastic#118356, elastic#118474)
671563e
mbondyra pushed a commit to mbondyra/kibana that referenced this issue Nov 19, 2021
@mistic @mbondyra
skip flaky suites (elastic#99581, elastic#118356, elastic#118474)
c1b4832
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.0

@jportner
Copy link
Contributor

New failure: CI Build - 8.0

Whoops, Tiago skipped this but it turns out we had two copies of the same test 🤦
I added a PR to remove the not-skipped test: #119206

dmlemeshko pushed a commit that referenced this issue Nov 29, 2021
@mistic @dmlemeshko
skip flaky suites (#99581, #118356, #118474)
d25a7bf
roeehub pushed a commit to build-security/kibana that referenced this issue Dec 16, 2021
@mistic
skip flaky suites (elastic#99581, elastic#118356, elastic#118474)
70af32e
@exalate-issue-sync exalate-issue-sync bot added impact:critical This issue should be addressed immediately due to a critical level of impact on the product. loe:small Small Level of Effort and removed loe:medium Medium Level of Effort impact:low Addressing this issue will have a low level of impact on the quality/strength of our product. labels Jan 25, 2022
@legrego legrego mentioned this issue May 10, 2022
Merged
@legrego legrego self-assigned this May 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@legrego legrego

Labels
failed-test A test failure on a tracked branch, potentially flaky-test impact:critical This issue should be addressed immediately due to a critical level of impact on the product. loe:small Small Level of Effort Team:Security Team focused on: Auth, Users, Roles, Spaces, Audit Logging, and more!
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix flaky spaces test thomheymann/kibana
Unskip flaky Space Selection tests legrego/kibana
7 participants
@thomheymann @spalger @legrego @mistic @jportner @elasticmachine @kibanamachine