-
Notifications
You must be signed in to change notification settings - Fork 573
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Not all data is uploaded to S3 bucket
in EndToEndTopicRecovery.test_restore
#5474
Comments
#5544 should fix it UPD: put the right link |
@LenaAn I think you meant to type a link to a PR, but it's a link back to this ticket |
I think it won't be fixed by #5544. I think that we just need to increase timeout or change the scale. The test generates a lot of small segments and simple not able to upload everything fast enough. |
Fixes redpanda-data#5474 'Not all data is uploaded to S3 bucket'. The problem is caused by the fact that we're generating huge number of segments in this test (message size was 10000, and number of messages was 100000). This commit decreases the message size to 5000 and increases the timeout for upload to 10 minutes.
We didn't meant to close this via #5544 then, right? This is failing 10% of the time over the weekend, e.g. https://buildkite.com/redpanda/redpanda/builds/13372#018252c5-c44e-416c-93fe-49609f5c1936 |
Correct. This PR #5736 should fix that. |
https://buildkite.com/redpanda/redpanda/builds/12555#0181fdac-cac8-4f45-b68c-aaf87809e4ab/1637-8802
See also #5241
The text was updated successfully, but these errors were encountered: