Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix/1406 unskip tests in loop #1949

Draft
wants to merge 26 commits into
base: main
Choose a base branch
from
Draft

Fix/1406 unskip tests in loop #1949

wants to merge 26 commits into from

Commits on Nov 14, 2023

  1. Run iOS 16 tests continuously and upload results to observability server

    @lawrence-forooghian
    lawrence-forooghian committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    7191523 View commit details
    Browse the repository at this point in the history

  2. Print xcodebuild raw output as part of loop 

    This is so that we can see things like library logs, or any additional
logging we might add to help debug a test case.
    @lawrence-forooghian
    lawrence-forooghian committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    92af9ad View commit details
    Browse the repository at this point in the history

  3. Add script for fetching test case logs from GitHub

    @lawrence-forooghian
    lawrence-forooghian committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    e61efb4 View commit details
    Browse the repository at this point in the history

  4. Upload .xcresult bundles as an artifact

    @lawrence-forooghian
    lawrence-forooghian committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    2b142cb View commit details
    Browse the repository at this point in the history

  5. Make sure continuously-run-tests-and-upload-results.sh doesn’t exceed… 

    … GitHub job running time limit

I’m trying to understand the reason that the upload artifacts step is
hung here [1], and I’m wondering if it’s because the job execution limit had
already been reached by my script.

[1] https://github.com/ably/ably-cocoa/runs/5979297645?check_suite_focus=true
    @lawrence-forooghian
    lawrence-forooghian committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    b774222 View commit details
    Browse the repository at this point in the history

  6. Log the size of .xcresult bundles waiting to be uploaded 

    To help with understanding issue described in b774222.
    @lawrence-forooghian
    lawrence-forooghian committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    12e2d11 View commit details
    Browse the repository at this point in the history

  7. Tar and zip the xcresult bundles 

    I’m hoping this will reduce the upload time (more by reducing the number
of files than the size).
    @lawrence-forooghian
    lawrence-forooghian committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    3e54f93 View commit details
    Browse the repository at this point in the history

  8. Add script for generating multiple jobs and workflows 

    This lets us choose the length and parallelism of our test runs.
    @lawrence-forooghian
    lawrence-forooghian committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    1940e9a View commit details
    Browse the repository at this point in the history

Commits on Feb 11, 2024

  1. Merge remote-tracking branch 'origin/main' into 1279-run-tests-in-loo… 

    …p-iOS17

# Conflicts:
#	.github/workflows/check-pod.yaml
#	.github/workflows/integration-test-iOS16_2.yaml
#	.github/workflows/integration-test.yaml
    @maratal
    maratal committed Feb 11, 2024
    Configuration menu
    Copy the full SHA
    d344300 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2024

  1. Merge remote-tracking branch 'origin/main' into 1279-run-tests-in-loo… 

    …p-iOS17
    @maratal
    maratal committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    886fc5e View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2024

  1. Unskip RealtimeClientConnectionTests tests that doesn't fail locally.

    @maratal
    maratal committed Jul 14, 2024
    Configuration menu
    Copy the full SHA
    ffff242 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'fix/1945-max-message-size' into fix/1406-unskip-tests

    @maratal
    maratal committed Jul 14, 2024
    Configuration menu
    Copy the full SHA
    8843277 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. Unskip RealtimeClientTests tests that doesn't fail locally.

    @maratal
    maratal committed Jul 15, 2024
    Configuration menu
    Copy the full SHA
    5ec2dac View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2024

  1. Merge branch 'main' into fix/1406-unskip-tests

    @maratal
    maratal committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    7108406 View commit details
    Browse the repository at this point in the history

  2. Unskip RestClientPresenceTests tests that doesn't fail locally.

    @maratal
    maratal committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    d3f2af7 View commit details
    Browse the repository at this point in the history

  3. Unskip RealtimeClientChannelTests tests that doesn't fail locally.

    @maratal
    maratal committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    54b23cc View commit details
    Browse the repository at this point in the history

  4. Unskip RestClientChannelTests tests that doesn't fail locally.

    @maratal
    maratal committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    1fbc2d5 View commit details
    Browse the repository at this point in the history

  5. Unskip AuthTests tests that doesn't fail locally.

    @maratal
    maratal committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    1e8e70c View commit details
    Browse the repository at this point in the history

  6. Unskip PushAdminTests tests that doesn't fail locally.

    @maratal
    maratal committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    1ee8e6d View commit details
    Browse the repository at this point in the history

  7. Unskip RestClientStatsTests tests that doesn't fail locally.

    @maratal
    maratal committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    1b09729 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2024

  1. Merge branch '1279-run-tests-in-loop-iOS17' into fix/1406-unskip-tests 

    # Conflicts:
#	.github/workflows/docs.yml
    @maratal
    maratal committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    4bbc5f6 View commit details
    Browse the repository at this point in the history

  2. Removed docs workflow.

    @maratal
    maratal committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    cc0c394 View commit details
    Browse the repository at this point in the history

  3. Fix Connection.maxMessageSize: if not set, take whatever is set in … 

    …`ARTDefault.maxMessageSize` first. If that is not set, then take the value depending on `options.isProductionEnvironment`.
    @maratal
    maratal committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    198139d View commit details
    Browse the repository at this point in the history

  4. Unskip "test__090...." test in RealtimeClientChannelTests.

    @maratal
    maratal committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    5751413 View commit details
    Browse the repository at this point in the history

  5. Fix expectDataToMatch function that was causing tests to fail. Unsk… 

    …ipped those tests.
    @maratal
    maratal committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    1cd9d0a View commit details
    Browse the repository at this point in the history

  6. Merge branch 'fix/1406-unskip-tests' into fix/1406-unskip-tests-in-loop

    @maratal
    maratal committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    a621525 View commit details
    Browse the repository at this point in the history