Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing test: "after each" hook for "Creates and activates a new custom rule with override option" - Detection rules, override "after each" hook for "Creates and activates a new custom rule with override option" #85671

Closed
kibanamachine opened this issue Dec 10, 2020 · 9 comments
Assignees
Labels
blocker failed-test A test failure on a tracked branch, potentially flaky-test Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:SIEM v7.11.0 v8.0.0

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Dec 10, 2020

A test failed on a tracked branch

CypressError: `cy.request()` failed on:

http://elastic:changeme@localhost:6151/api/solutions/security/graphql

The response we received from your web server was:

  > 400: Bad Request

This was considered a failure because the status code was not `2xx` or `3xx`.

If you do not want status codes to cause failures pass the option: `failOnStatusCode: false`

-----------------------------------------------------------

The request we sent was:

Method: POST
URL: http://elastic:changeme@localhost:6151/api/solutions/security/graphql
Headers: {
  "Connection": "keep-alive",
  "kbn-xsrf": "delete-signals",
  "user-agent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/87.0.4280.88 Safari/537.36",
  "accept": "*/*",
  "accept-encoding": "gzip, deflate",
  "authorization": "Basic ZWxhc3RpYzpjaGFuZ2VtZQ==",
  "content-type": "application/json",
  "content-length": 157
}
Body: {"operationName":"DeleteTimelineMutation","variables":{"id":[null]},"query":"mutation DeleteTimelineMutation($id: [ID!]!) {\n  deleteTimeline(id: $id)\n}\n"}

-----------------------------------------------------------

The response we got was:

Status: 400 - Bad Request
Headers: {
  "content-type": "application/json; charset=utf-8",
  "kbn-name": "kibana-ci-immutable-ubuntu-18-tests-xxl-1607634196457586066",
  "kbn-license-sig": "11a88980626736dd699d8f9f75172106e6a26228aefff99ea2b4f132147816db",
  "cache-control": "private, no-cache, no-store, must-revalidate",
  "content-length": "213",
  "date": "Thu, 10 Dec 2020 21:44:50 GMT",
  "connection": "keep-alive",
  "keep-alive": "timeout=120"
}
Body: {
  "message": "{\"errors\":[{\"message\":\"Variable \\\"$id\\\" got invalid value [null]; Expected non-nullable type ID! not to be null at value[0].\",\"locations\":[{\"line\":1,\"column\":33}]}]}",
  "status_code": 400
}


https://on.cypress.io/request

Because this error occurred during a `after each` hook we are skipping the remaining tests in the current suite: `Detection rules, override`
    at http://elastic:changeme@localhost:6151/__cypress/runner/cypress_runner.js:158924:21
    at tryCatcher (http://elastic:changeme@localhost:6151/__cypress/runner/cypress_runner.js:10584:23)
    at Promise._settlePromiseFromHandler (http://elastic:changeme@localhost:6151/__cypress/runner/cypress_runner.js:8519:31)
    at Promise._settlePromise (http://elastic:changeme@localhost:6151/__cypress/runner/cypress_runner.js:8576:18)
    at Promise._settlePromise0 (http://elastic:changeme@localhost:6151/__cypress/runner/cypress_runner.js:8621:10)
    at Promise._settlePromises (http://elastic:changeme@localhost:6151/__cypress/runner/cypress_runner.js:8701:18)
    at _drainQueueStep (http://elastic:changeme@localhost:6151/__cypress/runner/cypress_runner.js:5291:12)
    at _drainQueue (http://elastic:changeme@localhost:6151/__cypress/runner/cypress_runner.js:5284:9)
    at Async.../../node_modules/bluebird/js/release/async.js.Async._drainQueues (http://elastic:changeme@localhost:6151/__cypress/runner/cypress_runner.js:5300:5)
    at Async.drainQueues (http://elastic:changeme@localhost:6151/__cypress/runner/cypress_runner.js:5170:14)
From Your Spec Code:
    at Object.deleteTimeline (http://localhost:6151/__cypress/tests?p=cypress/integration/alerts_detection_rules_override.spec.ts:21507:8)
    at Context.eval (http://localhost:6151/__cypress/tests?p=cypress/integration/alerts_detection_rules_override.spec.ts:20334:21)

First failure: Jenkins Build

@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Dec 10, 2020
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

mistic added a commit that referenced this issue Dec 11, 2020
mistic added a commit that referenced this issue Dec 11, 2020
@mistic mistic added blocker Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:SIEM v7.11.0 v8.0.0 labels Dec 11, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/siem (Team:SIEM)

@mistic
Copy link
Member

mistic commented Dec 11, 2020

The test is being flaky both on master and 7.x. Skipping for now.

master/8.0: 63cafd7
7.x/7.11: fe1f01a

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

gmmorris added a commit to gmmorris/kibana that referenced this issue Dec 14, 2020
* master: (116 commits)
  Fix UX E2E tests (elastic#85722)
  Increasing default api key removalDelay to 1h (elastic#85576)
  align cors settings names with elasticsearch (elastic#85738)
  unskip tests and make sure submit is not triggered too quickly (elastic#85567)
  Row trigger 2 (elastic#83167)
  Add session id to audit log (elastic#85451)
  [TSVB] Fields lists do not populate all the times (elastic#85530)
  [Visualize] Removes the external link icon from OSS badges (elastic#85580)
  fixes EQL tests (elastic#85712)
  [APM] enable 'log_level' for Go (elastic#85511)
  ini `1.3.5` -> `1.3.7` (elastic#85707)
  Fix fleet route protections (elastic#85626)
  [Monitoring] Some progress on making alerts better in the UI (elastic#81569)
  [Security Solution] Refactor Timeline Notes to use EuiCommentList (elastic#85256)
  [Security Solution][Detections][Threshold Rules] Threshold rule exceptions (elastic#85103)
  [Security Solution] Alerts details (elastic#83963)
  skip flaky suite (elastic#62060)
  skip flaky suite (elastic#85098)
  skip flaky suite (elastic#84020)
  skip flaky suite (elastic#85671)
  ...
@MindyRS MindyRS added the Team:Detections and Resp Security Detection Response Team label Dec 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocker failed-test A test failure on a tracked branch, potentially flaky-test Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:SIEM v7.11.0 v8.0.0
Projects
None yet
Development

No branches or pull requests

7 participants