Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create script to run all release tests. #1106

Merged
merged 58 commits into from
Aug 3, 2020

Commits on Jul 7, 2020

  1. Squashed commit of the following:

    commit 67b6363
    Merge: fd80aff afdb125
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Tue Jul 7 12:22:14 2020 -0400
    
        Merge branch 'upstream-master' into scale-test-single-node
    
    commit fd80aff
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Tue Jul 7 12:20:56 2020 -0400
    
        Forgotten readme commit.
    
    commit dae08fd
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Tue Jul 7 12:20:43 2020 -0400
    
        Fix duration calculation for timeout, remove eksctl, revise readme.
    
    commit 80a50fd
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Tue Jul 7 01:04:09 2020 -0400
    
        Change image to kubernetes pause.
    
    commit 6104022
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Mon Jul 6 16:59:36 2020 -0400
    
        Revert back to 98 node startup.
    
    commit c7d9a5f
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Mon Jul 6 14:49:30 2020 -0400
    
        Reduce initial replicas to 1
    
    commit ddf7cd8
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Mon Jul 6 13:11:50 2020 -0400
    
        Add timeout to performance tests, add content to readme.
    
    commit 44092a6
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Mon Jul 6 11:56:52 2020 -0400
    
        Revert image to google.
    
    commit 2c8291e
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Thu Jul 2 15:36:18 2020 -0400
    
        Don't exit if s3 bucket upload fails.
    
    commit 318101a
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Thu Jul 2 13:37:36 2020 -0400
    
        Fix file path issue.
    
    commit 16254ad
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Wed Jul 1 17:07:12 2020 -0400
    
        Fix CircleCI yml syntax error.
    
    commit 43dd11d
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Wed Jul 1 17:05:34 2020 -0400
    
        Configure weekly performance.
    
    commit d9b58bb
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Wed Jul 1 16:57:17 2020 -0400
    
        Start mng with 1 node, put metadata into data file names, suppress copy errors.
    
    commit 5bab04d
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Wed Jul 1 02:43:28 2020 -0400
    
        Changes from PR.
    
    commit 72a8608
    Author: Ben Napolitan <bnapolitan@outlook.com>
    Date:   Fri Jun 26 11:58:25 2020 -0400
    
        Squashed commit of the following:
    
        commit 5aac358
        Merge: 0bcf24b 30f98bd
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Fri Jun 26 11:57:31 2020 -0400
    
            Merge branch 'upstream-master' into scale-test-single-node-old
    
        commit 0bcf24b
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Fri Jun 26 11:55:48 2020 -0400
    
            Revert rolling update change.
    
        commit 53866a0
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Thu Jun 25 16:22:33 2020 -0400
    
            Increase rollingupdate limit.
    
        commit 966466a
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Thu Jun 25 11:01:07 2020 -0400
    
            Fix environment unset environment variables.
    
        commit f429283
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Wed Jun 24 13:26:51 2020 -0400
    
            Remove sleeps, deleted load balancers in test account.
    
        commit 166a168
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Wed Jun 24 09:21:17 2020 -0400
    
            Attempt all scale tests.
    
        commit 81dd0aa
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Tue Jun 23 12:31:48 2020 -0400
    
            Try adding all node groups back.
    
        commit 828f7aa
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Tue Jun 23 11:37:35 2020 -0400
    
            Attempt only large performance test and no conformance.
    
        commit 82a80e7
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Mon Jun 22 18:02:59 2020 -0400
    
            Try deleting other node groups.
    
        commit 284fcd1
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Mon Jun 22 16:13:47 2020 -0400
    
            Trying again.
    
        commit e5ef16b
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Mon Jun 22 16:10:20 2020 -0400
    
            Altar size again.
    
        commit d1e0062
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Mon Jun 22 12:53:06 2020 -0400
    
            Attempt instance size change.
    
        commit 686e7f2
        Author: Ben Napolitan <bnapolitan@outlook.com>
        Date:   Fri Jun 19 16:47:51 2020 -0400
    
            Fix duplicate name.
    
        commit e17358c
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Fri Jun 19 14:04:58 2020 -0400
    
            Attempt 5000 pod scale test.
    
        commit e9ea95d
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Thu Jun 18 17:53:28 2020 -0400
    
            Attempt 730 pods on one node performance test.
    
        commit cad25af
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Thu Jun 18 13:26:51 2020 -0400
    
            Fix file output syntax.
    
        commit 974ac0e
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Thu Jun 18 11:42:30 2020 -0400
    
            Verify scale test uploading works.
    
        commit b7efa10
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Wed Jun 17 17:56:32 2020 -0400
    
            Create data file after scale test.
    
        commit 3a9eaec
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Mon Jun 15 14:27:37 2020 -0400
    
            Fix if syntax.
    
        commit 00d74bc
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Mon Jun 15 11:36:03 2020 -0400
    
            Run scale tests moved and hidden behind env var.
    
        commit ef6841e
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Sat Jun 13 21:35:21 2020 -0400
    
            Fix grep causing failure.
    
        commit 4fbce7e
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Sat Jun 13 18:37:11 2020 -0400
    
            Reduce sleep for scale test.
    
        commit d766018
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Sat Jun 13 13:32:50 2020 -0400
    
            Try to diagnose polling problem.
    
        commit 1ac7d35
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Fri Jun 12 17:46:54 2020 -0400
    
            Run scale test for 130 pods.
    
        commit 9933a09
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Fri Jun 12 13:29:32 2020 -0400
    
            Add new nodegroup and move directory copy to proper place.
    
        commit 470116c
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Fri Jun 12 12:04:48 2020 -0400
    
            Move to after kubeconfig.
    
        commit 1f1f0fb
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Fri Jun 12 01:19:04 2020 -0400
    
            Switch to use KUBECTL_PATH.
    
        commit 1b43268
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Thu Jun 11 23:46:58 2020 -0400
    
            Retry with one nodegroup.
    
        commit b0d3228
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Thu Jun 11 23:00:48 2020 -0400
    
            Try to create new nodegroup and apply deployment to it.
    
        commit abd9015
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Thu Jun 11 21:25:40 2020 -0400
    
            Correct cluster name and change region in CircleCI.
    
        commit 46fe54f
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Thu Jun 11 19:03:03 2020 -0400
    
            Get info for eksctl.
    
        commit bbb3557
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Wed Jun 10 16:08:26 2020 -0400
    
            Attempt to ssh into test run.
    
        commit 353130b
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Wed Jun 10 14:22:18 2020 -0400
    
            Delete eks nodegroup create.
    
        commit 0ff7589
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Wed Jun 10 13:14:51 2020 -0400
    
            Try to use eksctl.
    
        commit 3ec6da4
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Wed Jun 10 12:28:23 2020 -0400
    
            Syntax fix.
    
        commit e79b32f
        Author: Ben Napolitan <bennapol@amazon.com>
        Date:   Tue Jun 9 19:55:25 2020 -0400
    
            Trying to create nodegroup and deploy pods.
    bnapolitan committed Jul 7, 2020
    Configuration menu
    Copy the full SHA
    a8323cc View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2020

  1. Configuration menu
    Copy the full SHA
    c8b1f9b View commit details
    Browse the repository at this point in the history
  2. Syntax fix.

    bnapolitan committed Jul 8, 2020
    Configuration menu
    Copy the full SHA
    0cf8c5a View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2020

  1. Configuration menu
    Copy the full SHA
    cf2b5d8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    07b54f2 View commit details
    Browse the repository at this point in the history
  3. Create unique mng names.

    bnapolitan committed Jul 9, 2020
    Configuration menu
    Copy the full SHA
    55220bd View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2020

  1. Undo generated mng names.

    bnapolitan committed Jul 10, 2020
    Configuration menu
    Copy the full SHA
    ef4df24 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5a40307 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    542382b View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    40173e0 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    615517a View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2020

  1. Adjust name line number.

    bnapolitan committed Jul 11, 2020
    Configuration menu
    Copy the full SHA
    dcf5d4a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c7c3701 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2020

  1. Configuration menu
    Copy the full SHA
    3060990 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2020

  1. Configuration menu
    Copy the full SHA
    42b79e9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    485d598 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2d8d01b View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    efd0151 View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2020

  1. Configuration menu
    Copy the full SHA
    3d3f14e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a5b2086 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ee6a9ac View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2020

  1. Configuration menu
    Copy the full SHA
    9d0aa34 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0325ae5 View commit details
    Browse the repository at this point in the history
  3. Proper line splicing.

    bnapolitan committed Jul 15, 2020
    Configuration menu
    Copy the full SHA
    b76d9b0 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2020

  1. Attempt MNG sharing.

    bnapolitan committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    591deea View commit details
    Browse the repository at this point in the history
  2. Merge branch 'upstream-master' into scale-test-single-node

    # Conflicts:
    #	scripts/run-integration-tests.sh
    bnapolitan committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    ebef0ae View commit details
    Browse the repository at this point in the history
  3. Fix merging issue.

    bnapolitan committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    5e01f11 View commit details
    Browse the repository at this point in the history
  4. Setup weekly test.

    bnapolitan committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    711896a View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2020

  1. Setup weekly cron.

    bnapolitan committed Jul 17, 2020
    Configuration menu
    Copy the full SHA
    1a5bbfc View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e4d603f View commit details
    Browse the repository at this point in the history
  3. Fix slow checking.

    bnapolitan committed Jul 17, 2020
    Configuration menu
    Copy the full SHA
    7e2ad40 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    d43d4a6 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    c5c9564 View commit details
    Browse the repository at this point in the history
  6. Fix weekly test syntax.

    bnapolitan committed Jul 17, 2020
    Configuration menu
    Copy the full SHA
    449f88c View commit details
    Browse the repository at this point in the history
  7. Scale up to 99 nodes.

    bnapolitan committed Jul 17, 2020
    Configuration menu
    Copy the full SHA
    082901b View commit details
    Browse the repository at this point in the history
  8. Fix yaml syntax.

    bnapolitan committed Jul 17, 2020
    Configuration menu
    Copy the full SHA
    4811d74 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    f674a55 View commit details
    Browse the repository at this point in the history
  10. Look back 70 lines.

    bnapolitan committed Jul 17, 2020
    Configuration menu
    Copy the full SHA
    487ce50 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    439ea17 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2020

  1. Change weekly test time.

    bnapolitan committed Jul 18, 2020
    Configuration menu
    Copy the full SHA
    a2f8c27 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0e7ef6e View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2020

  1. Configuration menu
    Copy the full SHA
    56b0118 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2020

  1. Merge branch 'upstream-master' into scale-test-single-node

    # Conflicts:
    #	scripts/run-integration-tests.sh
    bnapolitan committed Jul 22, 2020
    Configuration menu
    Copy the full SHA
    b46b3ea View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    18b10c5 View commit details
    Browse the repository at this point in the history
  3. Attempt all tests script.

    bnapolitan committed Jul 22, 2020
    Configuration menu
    Copy the full SHA
    85a90fb View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    2f1c30a View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    19b619b View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    330456f View commit details
    Browse the repository at this point in the history
  7. Try permissions again?

    bnapolitan committed Jul 22, 2020
    Configuration menu
    Copy the full SHA
    0a0c436 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2020

  1. Configuration menu
    Copy the full SHA
    9b4771d View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2020

  1. Merge branch 'upstream-master' into run-all-tests-script

    # Conflicts:
    #	.circleci/config.yml
    bnapolitan committed Jul 27, 2020
    Configuration menu
    Copy the full SHA
    55eaeea View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2020

  1. Attempt all test runs.

    bnapolitan committed Jul 28, 2020
    Configuration menu
    Copy the full SHA
    e0ed8de View commit details
    Browse the repository at this point in the history
  2. readme update.

    bnapolitan committed Jul 28, 2020
    Configuration menu
    Copy the full SHA
    7c20f75 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2020

  1. Configuration menu
    Copy the full SHA
    b1ff7ff View commit details
    Browse the repository at this point in the history
  2. Add graph links.

    bnapolitan committed Jul 29, 2020
    Configuration menu
    Copy the full SHA
    5c75af0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    bb5cf8f View commit details
    Browse the repository at this point in the history
  4. Fix incorrect approval.

    bnapolitan committed Jul 29, 2020
    Configuration menu
    Copy the full SHA
    b3eb52d View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2020

  1. Merge branch 'master' into run-all-tests-script

    Claes Mogren committed Aug 3, 2020
    Configuration menu
    Copy the full SHA
    75322f1 View commit details
    Browse the repository at this point in the history