Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Attempt to fix flacky test '00910_zookeeper_test_alter_compression_codecs' #9525

Merged
merged 3 commits into from
Mar 5, 2020

Conversation

alexey-milovidov
Copy link
Member

Changelog category (leave one):

  • Build/Testing/Packaging Improvement

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
Fix flacky test 00910_zookeeper_test_alter_compression_codecs.

Detailed description / Documentation draft:

Alexey Milovidov, [05.03.20 15:14]
00910_zookeeper_test_alter_compression_codecs
- странно, стал не проходить почти всё время.

Alexander Sapin, [05.03.20 15:29]
[In reply to Alexey Milovidov]
Там нужно выставить настройку, чтобы альтер синхронно делался на всех репликах . А то мы запускаем альтер и сразу идём в system.columns и срабатывает твоя защита. Видимо старый успевал, а новый иногда не успевает.

Alexey Milovidov, [05.03.20 15:32]
[In reply to Alexander Sapin]
Понял, банальный рейс в тесте. Сейчас попробую выставить.

Alexey Milovidov, [05.03.20 15:35]
@Alesapin Я не понял, какую именно настройку выставлять, сейчас запутано. Есть mutations_sync и replication_alter_partitions_sync. Вторая точно не влияет, а первая теперь влияет на ALTER столбцов?

Alexey Milovidov, [05.03.20 15:38]
@Alesapin А разве не во время запроса, а во время применения ALTER, берётся табличный RWLock? А зачем?

Иван Блинков, [05.03.20 15:43]
[In reply to Alexey Milovidov]
Саша говорит, что надо выставить replication_alter_partitions_sync=2

Alexey Milovidov, [05.03.20 15:44]
[In reply to Иван Блинков]
Какой ужас. При чём тут партиции :(

Иван Блинков, [05.03.20 15:47]
[In reply to Alexey Milovidov]
Саша говорит, что она уже так называлась раньше. Не переименовывать же.

@alexey-milovidov alexey-milovidov added the pr-build Pull request with build/testing/packaging improvement label Mar 5, 2020
@alexey-milovidov
Copy link
Member Author

Also removed test prefix to use random database.

@alexey-milovidov
Copy link
Member Author

for i in {1..100}; do ./clickhouse-test --zookeeper zookeeper_test_alter_compression_codecs; done
Ok in debug build.

@alexey-milovidov
Copy link
Member Author

It did not help:

THREAD_FUZZER_CPU_TIME_PERIOD_US=1000 THREAD_FUZZER_SLEEP_PROBABILITY=0.1 THREAD_FUZZER_SLEEP_TIME_US=100000 ./clickhouse-server
00910_zookeeper_test_alter_compression_codecs:                          [ OK ]

1 tests passed. 0 tests skipped.

Running 1 stateless tests.

00910_zookeeper_test_alter_compression_codecs:                          [ FAIL ] - return code 217
Received exception from server (version 20.3.1):
Code: 473. DB::Exception: Received from localhost:9000. DB::Exception: Possible deadlock avoided. Client should retry.: While executing Columns. 


Having 1 errors! 0 tests passed. 0 tests skipped.

Running 1 stateless tests.

00910_zookeeper_test_alter_compression_codecs:                          [ FAIL ] - return code 122
Received exception from server (version 20.3.1):
Code: 122. DB::Exception: Received from localhost:9000. DB::Exception: Table columns structure in ZooKeeper is different from local table structure.

@alexey-milovidov
Copy link
Member Author

The setting SET replication_alter_partitions_sync = 1; also does not help.

@alesapin
Copy link
Member

alesapin commented Mar 5, 2020

You have to set setting to 2, because 1 is default, so in the begging of the test:
SET replication_alter_partitions_sync = 2;

@alexey-milovidov alexey-milovidov merged commit 0412d5f into master Mar 5, 2020
@alexey-milovidov alexey-milovidov deleted the fix-flacky-alter-test branch March 5, 2020 18:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pr-build Pull request with build/testing/packaging improvement
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants