Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pairwise test outcome depends on execution order #175

Closed
rzabini opened this issue Aug 14, 2021 · 1 comment
Closed

Pairwise test outcome depends on execution order #175

rzabini opened this issue Aug 14, 2021 · 1 comment
Assignees

Comments

@rzabini
Copy link
Contributor

rzabini commented Aug 14, 2021

Pairwise tests rely on a random variable to generate the subset of permutations. This variable is defined as static in the Case class.

So the random value(s) obtained by test methods in PairwiseTest class depend on the execution order of these methods, and if one of them is added/removed, altering the order, the set of values in the received file may be different from the set in the approved file. For instance, commenting out the testPairs method, the testPairsScrubbed fails.

I think that the issue may be solved by making non-static the random variable (and the corresponding method).

@LarsEckart LarsEckart self-assigned this Aug 16, 2021
@LarsEckart
Copy link
Contributor

thank you!

Fixed in 12.0.1 which is being released right now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants