[v22.2.x] tests: update ManyPartitionsTest #6044
Commits on Aug 15, 2022
-
cluster: fix leader balancer error log
This was outputting number, should have been outputting message. (cherry picked from commit 8787da4)
-
tests: re-order Dockerfile for faster go rebuilds
The go dependencies are generally the fastest to build and should not get held up behind other things: - Move OMB (Java build) further up - split `kaf` install from unrelated non-go stuff. - move client-swarm build before go test utils (cherry picked from commit 73edc8a)
-
tests: fix NodeCrash prints in logs
So that it shows the node name properly (cherry picked from commit 06e92c8)
-
tests: permit tests to configure per-logger verbosity
This is for the benefit of scale tests, which would like to reduce their per-partition outputs to reflect how a user would configure the system, and to reduce any overhead from emitting millions of lines. (cherry picked from commit 8fb6d0d)
-
test: introduce KgoRepeaterService
This wraps the new `kgo-repeater` traffic generator for scalable load generation. (cherry picked from commit 763381f)
-
tests: improve logging on failure
It is helpful to print the error right at the point of failure, rather than after the (potentially long running) backtrace decode & log search jobs. It'll get printed again later as well, but this way I can search from the start of the file for the exception name, and jump straight to the timestamp of the failure. (cherry picked from commit d3a3087)
-
tests: fail out early if not on XFS in clustered ducktape
This is a nasty failure mode where we deploy fresh packages and accidentally wip out our /var/lib/redpanda symlink, resulting in running tests on very slow drives. (cherry picked from commit 087d653)
-
tests/services: optionally start redpandas in parallel
This is an efficiency/quality of life improvement for working with tests that start larger numbers of nodes. Leave the default as serial startup, because it makes logs easier to read. (cherry picked from commit ae72725)
-
tests/services: progress %ge from FranzGoVerifiableProducer
This is useful if a test is running longer than you expected and you'd like to know how far through it is without doing your own calculation of message counts. (cherry picked from commit 1432357)
-
tests/clients: add permissive mode for rpk describe_topic
When using this function to query leadership for partitions, it is not necessary to exclude partitions just because they failed to get some metadata from the leader (e.g. NOT_LEADER errors for offets during transient leaderhsip change). Add a `tolerant` flag that permits returning partially populated RpkPartition results that just show the leader of a partition. (cherry picked from commit d50400a)
-
tests/clients: improve rpk group describe error handling
(cherry picked from commit b92846b)
-
tests/clients: summary mode for describe group
The default mode is rather expensive for high partition counts, and complicates handling systems in transient states when one or more of the partitions is likely to be underoing leadership movement and therefore have NOT_LEADER errors etc in the default per-partition output. When all we want to know is the group's state, this lets us get that. (cherry picked from commit 0c687f9)
-
tests/clients: rpk describe group error handling
(cherry picked from commit bcb2102)
-
tests/services: enable running OMB with pre-allocated nodes
(cherry picked from commit 75f64f1)
-
tests: use improved wait_until for prealloc_nodes
(cherry picked from commit 4a82326)
-
tests/services: enable customizing OMB message size
(cherry picked from commit b24f4bd)
-
tests/services: option to set stall threshold in RedpandaSettings
(cherry picked from commit 1a47771)
-
tests/docker: update to latest kgo-verifier (includes kgo-repeater)
(cherry picked from commit 5e895f2)
-
tests: make ManyPartitionsTest flexible-size
This enables: - Running on different instance types without hacking the test - Running on local docker while developing the test itself. (cherry picked from commit e248199)
-
tests: revise & extend ManyPartitionsTest
(cherry picked from commit e152c8e)
-
tests/services: workaround kgo-repeater consumers disappearing sometimes
I think this is a bug with the workload generator (or, unlikely perhaps a problem with franz-go). It is usually only a few consumers that disappear from the group, so it doesn't hurt the validity of the overall scale test, and we can hunt it down separately. (cherry picked from commit c17e2cb)
-
tests: clearer message in XFS filesystem check
(cherry picked from commit 8a684c0)
-
tests: simplify RedpandaService._for_nodes
...use a single `map` instead of loops. (cherry picked from commit ea8f563)
-
tests: improve docs + validation on OMB class constructors
(cherry picked from commit 0cd912a)
-
tests: minor cleanup in ResourceSettings
(cherry picked from commit 6368280)
-
tests: cleanup in ManyPartitionsTest
This is followup from PR redpanda-data#5816 (cherry picked from commit 1689a72)
