Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[chore] Fix loadtest setup script #33860

Merged

Conversation

mowies
Copy link
Member

@mowies mowies commented Jul 2, 2024

Description:
This PR fixes the load test pipeline which was broken for a while.
The array of tests was not iterated over correctly in https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/main/.github/workflows/scripts/setup_e2e_tests.sh and the first iteration of the loop resulted in the whole array being added to the matrix instead of just the first entry of the array.

I introduced a different way to read in the array of tests at the start of the setup bash script, which works now.
source for the solution

Link to tracking Issue: Fixes #33577

Testing: Tested successfully on my personal fork. This is a link to a load test run where the matrix is correctly parsed by github actions.

Documentation: nothing to document

Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com>
@mowies mowies marked this pull request as ready for review July 2, 2024 13:19
@mowies mowies requested review from a team and Aneurysm9 July 2, 2024 13:19
@arminru arminru changed the title Fix loadtest setup script [chore] Fix loadtest setup script Jul 2, 2024
@arminru arminru requested a review from codeboten July 2, 2024 14:03
@evan-bradley evan-bradley added the Skip Changelog PRs that do not require a CHANGELOG.md entry label Jul 2, 2024
Copy link
Contributor

@codeboten codeboten left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @mowies

@codeboten codeboten merged commit cce9800 into open-telemetry:main Jul 2, 2024
161 checks passed
@arminru arminru deleted the fix-load-test-pipeline branch July 2, 2024 16:21
@github-actions github-actions bot added this to the next release milestone Jul 2, 2024
mx-psi pushed a commit that referenced this pull request Jul 4, 2024
**Description:** <Describe what has changed.>
<!--Ex. Fixing a bug - Describe the bug and how this fixes the issue.
Ex. Adding a feature - Explain what this achieves.-->
This PR fixes more issues with the load test pipeline. Specifically, it
adjusts some things around artifact up/download which is needed as a
result of the breaking changes in GitHub Actions artifacts listed
[here](https://github.com/actions/upload-artifact#breaking-changes:~:text=Uploading%20to%20the%20same%20named,you%20will%20encounter%20an%20error.).
Also, it removes the issue generation step which seems far outdated as
it's failing with missing CircleCI env variables.

Also, I noticed that a few of the load tests fail consistently. To test.
the pipeline, I had to comment them out. Not sure, what to do with
them...

**Link to tracking Issue:**
Part of
#33577
Follow up to
#33860

**Testing:** Testing done on my personal fork. Link to working pipeline
run:
[Green run with some broken tests commented out, but pipeline
working](https://github.com/mowies/opentelemetry-collector-contrib/actions/runs/9789652148)
[Red run with broken
tests](https://github.com/mowies/opentelemetry-collector-contrib/actions/runs/9790395589)

**Documentation:** none added

---------

Signed-off-by: Moritz Wiesinger <moritz.wiesinger@dynatrace.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Skip Changelog PRs that do not require a CHANGELOG.md entry
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[testbed/mockdatasenders/mockdatadogagentexporter] Broken load test
4 participants