500 response from admin API (Failure in rptest.tests.partition_balancer_test.PartitionBalancerTest.test_movement_cancellations)

[abhijat]

status:     FAIL
run time:   6 minutes 34.999 seconds
 
    NodeCrash([(<ducktape.cluster.cluster.ClusterNode object at 0x7f3d1bdedcc0>, 'Redpanda process unexpectedly stopped')])
Traceback (most recent call last):
  File "/root/tests/rptest/services/cluster.py", line 35, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/tests/partition_balancer_test.py", line 194, in test_movement_cancellations
    self.wait_until_ready()
  File "/root/tests/rptest/tests/partition_balancer_test.py", line 95, in wait_until_ready
    return self.wait_until_status(
  File "/root/tests/rptest/tests/partition_balancer_test.py", line 87, in wait_until_status
    return wait_until_result(
  File "/root/tests/rptest/util.py", line 110, in wait_until_result
    wait_until(wrapped_condition, *args, **kwargs)
  File "/root/tests/rptest/util.py", line 68, in wait_until
    raise e
  File "/root/tests/rptest/util.py", line 61, in wait_until
    if condition():
  File "/root/tests/rptest/util.py", line 97, in wrapped_condition
    cond = condition()
  File "/root/tests/rptest/tests/partition_balancer_test.py", line 76, in check
    status = admin.get_partition_balancer_status(timeout=1)
  File "/root/tests/rptest/services/admin.py", line 718, in get_partition_balancer_status
    return self._request("GET",
  File "/root/tests/rptest/services/admin.py", line 334, in _request
    r.raise_for_status()
  File "/usr/local/lib/python3.10/dist-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://docker-rp-24:9644/v1/cluster/partition_balancer/status
 
During handling of the above exception, another exception occurred:
 
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 135, in run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 227, in run_test
    return self.test_context.function(self.test)
  File "/root/tests/rptest/services/cluster.py", line 38, in wrapped
    self.redpanda.raise_on_crash()
  File "/root/tests/rptest/services/redpanda.py", line 1044, in raise_on_crash
    raise NodeCrash(crashes)
rptest.services.utils.NodeCrash: <NodeCrash docker-rp-2: Redpanda process unexpectedly stopped>

seen during build: https://buildkite.com/redpanda/redpanda/builds/13241#018243d2-6ccd-428b-8aff-280eac652a0e

[jcsp]

Same failure mode seen here: https://buildkite.com/redpanda/redpanda/builds/13181#01824009-0676-4124-a71f-43a5dbf1a412

[jcsp]

This one fortunately isn't a crash, the NodeCrash indicator is coming from the test failing while FailureInjector had a node stopped.

It is a definite redpanda bug though, a 500 from the admin API.

[ZeDRoman]

This issue is duplicate of #5531
It was fiixed 6 hours ago.
I think, these fails was before fix had been merged