Error: seastar::condition_variable_timed_out (Condition variable timed out)

[ajfabbri]

This showed up as a CI failure here, and I cannot tell from the logs which condition variable has timed out. (link to log file)

This happened in NodeResizeTest test_node_resize, but I'm guessing this is a general error that can occur with any test, considering that it is explicitly allowed in chaos tests.

ERROR 2022-06-18 06:52:16,604 [shard 0] rpc - Service handler threw an exception: seastar::condition_variable_timed_out (Condition variable timed out)

To Fix: add better diagnostic logging (e.g. named semaphore) so we have a chance of narrowing these down.

[BenPope]

Also seen here: https://buildkite.com/redpanda/redpanda/builds/13189#0182405d-4b84-40a9-b24d-4684856b7cb6

[andrwng]

@ajfabbri I think this will be fixed by #5734