Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce approval-voting/distribution benchmark #2621

Merged
merged 247 commits into from
Feb 5, 2024
Merged
Changes from 1 commit
Commits
Show all changes
247 commits
Select commit Hold shift + click to select a range
7230df4
merge from archived repo
sandreim Aug 25, 2023
d04c182
cargo lock
sandreim Aug 25, 2023
f4f0e70
Merge remote-tracking branch 'origin' into sandreim/the_v2_assignments
sandreim Aug 25, 2023
341c7af
Approve multiple candidates with a single signature
alexggh Aug 25, 2023
619fff2
Fix build warnings
alexggh Aug 27, 2023
5f1558d
Merge remote-tracking branch 'origin/master' into feature/approve_mul…
alexggh Aug 27, 2023
ed1d9d0
ci: fix worker binaries could not be found
alexggh Aug 28, 2023
7d7b82c
Add missing bits
alexggh Aug 28, 2023
7bc13d3
Build with network-protocol-staging
alexggh Aug 28, 2023
53f8556
Validate disconnect theory
alexggh Aug 28, 2023
442b1e4
Merge branch 'master' of github.com:paritytech/polkadot-sdk into sand…
sandreim Aug 28, 2023
5e004e1
Log errors when banning peers
alexggh Aug 28, 2023
9850b2f
fix zombienet test
sandreim Aug 28, 2023
f71eb31
Merge branch 'master' of github.com:paritytech/polkadot-sdk into sand…
sandreim Aug 29, 2023
46cfaf1
cargo lock
sandreim Aug 29, 2023
0086502
Merge branch 'master' of github.com:paritytech/polkadot-sdk into sand…
sandreim Aug 30, 2023
47beabd
superfluous
sandreim Aug 30, 2023
ee88408
Merge branch 'master' into sandreim/the_v2_assignments
sandreim Aug 31, 2023
3d3e37c
Separate approval
alexggh Aug 30, 2023
da61d98
Revert "Log errors when banning peers"
alexggh Sep 1, 2023
9c0375c
Merge remote-tracking branch 'origin/sandreim/the_v2_assignments' int…
alexggh Sep 1, 2023
f3fee24
Cleanup post migrating hacks when migrating from polkadot repo
alexggh Sep 1, 2023
6338d33
Fixup clippy
alexggh Sep 1, 2023
d4fb01a
Merge remote-tracking branch 'origin/master' into feature/approve_mul…
alexggh Sep 25, 2023
5832ad7
Merge remote-tracking branch 'origin/master' into sandreim/the_v2_ass…
alexggh Sep 26, 2023
989bbcc
Merge branch 'sandreim/the_v2_assignments' into feature/approve_multi…
alexggh Sep 26, 2023
7fdae09
Add host configuration v10 with approval_voting params
alexggh Sep 26, 2023
e70b113
Fixup failure of lint-markdown
alexggh Sep 26, 2023
85939bb
Fixup test-rustdoc job
alexggh Sep 26, 2023
a6df360
Merge branch 'sandreim/the_v2_assignments' into feature/approve_multi…
alexggh Sep 26, 2023
d42f373
Cosmetic fixes
alexggh Sep 27, 2023
6dd5173
pipeline/zombinet: fix 0006 test name
alexggh Sep 27, 2023
b54ee85
Merge branch 'sandreim/the_v2_assignments' into feature/approve_multi…
alexggh Sep 27, 2023
0bdc06e
fixup cargo fmt nightly
alexggh Sep 27, 2023
218748d
fixup clippy
alexggh Sep 27, 2023
0335cf1
Fixup markdownlint
alexggh Sep 28, 2023
0f0faf0
Fixup runtime-migration-westend
alexggh Sep 28, 2023
6eabb63
approval-voting: address round 1 of feedback
alexggh Sep 28, 2023
9dc4a93
approval-distribution: cosmetic improvements
alexggh Sep 28, 2023
566d7f5
Comment vstaging
alexggh Sep 29, 2023
460bab2
Revert "Comment vstaging"
alexggh Sep 29, 2023
85acb51
Add v3 protocol
alexggh Sep 29, 2023
6a1fb87
Merge remote-tracking branch 'origin/master' into sandreim/the_v2_ass…
alexggh Sep 29, 2023
56055c1
Fixup
alexggh Sep 30, 2023
477a4bb
Merge remote-tracking branch 'origin/master' into sandreim/the_v2_ass…
alexggh Oct 10, 2023
595000d
Merge remote-tracking branch 'origin/master' into sandreim/the_v2_ass…
alexggh Oct 10, 2023
5579719
Fix cargo fmt
alexggh Oct 11, 2023
03d92ce
Merge remote-tracking branch 'origin/master' into sandreim/the_v2_ass…
alexggh Oct 11, 2023
f68baea
Merge remote-tracking branch 'origin/sandreim/the_v2_assignments' int…
alexggh Oct 16, 2023
ee3b702
approval-distribution: fix unittests
alexggh Oct 16, 2023
0d2fbba
Approval voting fixup
alexggh Oct 16, 2023
e672c1d
Fixup runtime api post merge
alexggh Oct 16, 2023
b053f92
Merge remote-tracking branch 'origin/master' into sandreim/the_v2_ass…
alexggh Oct 17, 2023
cff7a3a
Merge remote-tracking branch 'origin/sandreim/the_v2_assignments' int…
alexggh Oct 17, 2023
deccd98
Fixup clippy
alexggh Oct 17, 2023
4d0e67e
Merge remote-tracking branch 'origin/sandreim/the_v2_assignments' int…
alexggh Oct 17, 2023
807308e
Merge remote-tracking branch 'origin/master' into sandreim/the_v2_ass…
alexggh Oct 17, 2023
cccf581
Merge remote-tracking branch 'origin/sandreim/the_v2_assignments' int…
alexggh Oct 17, 2023
cc5a8fe
Minor cleanups
alexggh Oct 17, 2023
e24d889
Add metric to see average delayed tick
alexggh Oct 17, 2023
eebde47
Fixup CI
alexggh Oct 17, 2023
f400d5a
ApprovalVotingParams sane default
alexggh Oct 17, 2023
0a952c0
Add zombienet to check approval coalescing
alexggh Oct 18, 2023
183ba64
Fix review typo
alexggh Oct 19, 2023
3fe8c0d
Remove file accidentally added which was removed from master
alexggh Oct 19, 2023
fc28618
Remove the need for CollationVersion::VStaging
alexggh Oct 19, 2023
056713b
Merge remote-tracking branch 'origin/master' into sandreim/the_v2_ass…
alexggh Oct 19, 2023
a8d234c
Addressed review comments
alexggh Oct 19, 2023
d728cf2
Make clippy happy
alexggh Oct 19, 2023
05ea75d
Build a test image with `network-protocol-staging`
alexggh Oct 19, 2023
261285f
Enable assignments
alexggh Oct 20, 2023
db9c3a9
Revert "Enable assignments v2 used for testing"
alexggh Oct 20, 2023
01af630
skeleton
sandreim Oct 25, 2023
3893f16
Merge remote-tracking branch 'origin/master' into sandreim/the_v2_ass…
alexggh Oct 25, 2023
15eaa0a
Cleanup un-needed dependency to test-helpers
alexggh Oct 26, 2023
a7d6a6e
Merge remote-tracking branch 'origin/sandreim/the_v2_assignments' int…
alexggh Oct 26, 2023
be9dddd
Address review findings
alexggh Oct 26, 2023
2385fad
Address review findings
alexggh Oct 26, 2023
a2c0320
Add new approval_db version
alexggh Oct 27, 2023
c8eff61
Modify the way we are doing the sampling
alexggh Oct 31, 2023
64f2195
Fixup check_rejects_delay_bad_vrf
alexggh Oct 31, 2023
04798fa
Address some trivial review feedback
alexggh Oct 31, 2023
440c38b
Use VersionedMigration
alexggh Oct 31, 2023
569ebb7
Do not accept ValidDisputeStatementKind::ApprovalCheckingMultipleCand…
alexggh Oct 31, 2023
ac2271b
Make approval_voting_params session buferred
alexggh Nov 1, 2023
059ce03
Merge remote-tracking branch 'origin/master' into sandreim/the_v2_ass…
alexggh Nov 1, 2023
35cbc0e
Make clippy happy
alexggh Nov 1, 2023
a097f70
Merge remote-tracking branch 'origin/sandreim/the_v2_assignments' int…
alexggh Nov 1, 2023
3af9517
Address review feedback in relay_vrf_modulo_cores
alexggh Nov 3, 2023
1b84bb0
Address more review feedback
alexggh Nov 3, 2023
7a1c88c
Add few more tests
alexggh Nov 3, 2023
ec71215
Fix unittest
alexggh Nov 5, 2023
552e6fa
Add pr_doc
alexggh Nov 5, 2023
2625def
Build a test image with `network-protocol-staging`
alexggh Oct 19, 2023
43f5529
Build a test image with assignments enabled
alexggh Oct 20, 2023
590b59e
Cleanup un-needed structures
alexggh Nov 5, 2023
bd76cf6
Revert test configurations
alexggh Nov 5, 2023
20cb37a
Fix upgrade to latest zombienet version
alexggh Nov 6, 2023
311b573
Set correct log level
alexggh Nov 6, 2023
418b69c
Merge remote-tracking branch 'origin/sandreim/the_v2_assignments' int…
alexggh Nov 6, 2023
46f7f4d
Make zombient behave with latest cli
alexggh Nov 6, 2023
a2e6024
Fix ocasional no-shows in zombienets
alexggh Nov 6, 2023
7c22abe
wip
sandreim Nov 6, 2023
c3adc77
measure tput and fixes
sandreim Nov 6, 2023
1955b71
Merge remote-tracking branch 'origin/master' into feature/approve_mul…
alexggh Nov 7, 2023
cd81d38
Fixup comment
alexggh Nov 7, 2023
624bb5f
Fix genesis error in zombienet
alexggh Nov 7, 2023
31b0351
add network emulation
sandreim Nov 7, 2023
e4bb037
cleanup
sandreim Nov 7, 2023
a694924
Add latency emulation
sandreim Nov 7, 2023
b0faa09
Minor fixes
alexggh Nov 8, 2023
7ca4dba
support multiple pov sizes
sandreim Nov 8, 2023
0430b5b
new metric in recovery and more testing
sandreim Nov 8, 2023
027bcd8
CLI update and fixes
sandreim Nov 9, 2023
5a05da0
peer stats
sandreim Nov 9, 2023
895e8d6
Switch stats to atomics
sandreim Nov 10, 2023
a2fb0c9
add more network metrics, new load generator
sandreim Nov 12, 2023
d1b9fa3
refactor
sandreim Nov 14, 2023
c5937ab
pretty cli + minor refactor + remove unused
sandreim Nov 15, 2023
d6c259d
update
sandreim Nov 15, 2023
050529b
remove comment
sandreim Nov 15, 2023
cb38be5
separate cli options for availability
sandreim Nov 17, 2023
24a736a
implement unified and extensible configuration
sandreim Nov 17, 2023
ee6b467
Merge remote-tracking branch 'origin/master' into feature/approve_mul…
alexggh Nov 22, 2023
2843865
Prepare to swtich to overseer
sandreim Nov 24, 2023
fd4620e
Merge branch 'master' of github.com:paritytech/polkadot-sdk into sand…
sandreim Nov 24, 2023
b17a147
add mocked subsystems
sandreim Nov 27, 2023
4724d8c
full overseer based implementation complete
sandreim Nov 27, 2023
7aed30f
make clean
sandreim Nov 27, 2023
b51485b
more cleaning
sandreim Nov 27, 2023
7e46444
more cleaning
sandreim Nov 27, 2023
d3df927
proper overseer control
sandreim Nov 27, 2023
7557768
refactor CLI display of env stats
sandreim Nov 27, 2023
787dc00
Add grafana dashboards for DA read
sandreim Nov 28, 2023
cd18f8d
network stats fixes
sandreim Nov 28, 2023
e8506b3
move examples and grafana
sandreim Nov 28, 2023
cbb6772
Add readme
sandreim Nov 28, 2023
1a80870
fmt + readme updates
sandreim Nov 28, 2023
eb49ea0
update dashboard and sample
sandreim Nov 28, 2023
b249056
remove unused
sandreim Nov 28, 2023
7fbcdfc
Merge branch 'master' of github.com:paritytech/polkadot-sdk into sand…
sandreim Nov 28, 2023
fb34181
revert unneeded changes
sandreim Nov 28, 2023
3a716a5
add missing comments and minor fixes
sandreim Nov 29, 2023
a092b76
clippy
sandreim Nov 29, 2023
ca27370
zepter format features --fix
sandreim Nov 29, 2023
be814e5
fix markdown
sandreim Nov 29, 2023
11ce8f5
remove sleep till end of block
sandreim Nov 29, 2023
8d93abc
review
sandreim Nov 29, 2023
af141ee
Emulated network improvements
sandreim Dec 1, 2023
29d80fa
fix comment
sandreim Dec 1, 2023
84721eb
Approval-voting subsytem draf1
alexggh Dec 4, 2023
1bda031
Merge remote-tracking branch 'origin/master' into feature/approve_mul…
alexggh Dec 5, 2023
5cb4b2a
Merge branch 'feature/approve_multiple_candidates_polkadot_sdk_v4' in…
alexggh Dec 5, 2023
4f9d8fd
Subsystem improvements
alexggh Dec 6, 2023
b39f65f
approvals optimisation
alexggh Dec 6, 2023
5644f81
Add fix number of tranches
alexggh Dec 6, 2023
c4bf254
Merge branch 'master' of github.com:paritytech/polkadot-sdk into sand…
sandreim Dec 7, 2023
c5a6143
availability distribution + bitfield distribution
sandreim Dec 7, 2023
c2a4d65
Merge remote-tracking branch 'origin/master' into feature/approve_mul…
alexggh Dec 7, 2023
5e78127
Revert a2e602444662bd0e2443219b438d609da62a995d
alexggh Dec 7, 2023
992e766
Address review feedback
alexggh Dec 7, 2023
1913b63
protocol: rename vstaging into v3
alexggh Dec 7, 2023
54e8698
WIP
sandreim Dec 7, 2023
871e9cf
Remove network-protocol-staging
alexggh Dec 7, 2023
ec0a988
Merge remote-tracking branch 'origin/master' into feature/approve_mul…
alexggh Dec 8, 2023
a364b64
Rename zombienet
alexggh Dec 8, 2023
5bfe2d9
add fn to wait on metric and CLI output changes
sandreim Dec 8, 2023
74e68bb
Merge branch 'master' of github.com:paritytech/polkadot-sdk into sand…
sandreim Dec 8, 2023
4d21e5b
cargo lock
sandreim Dec 8, 2023
3e25fdc
more review feedback
sandreim Dec 8, 2023
1458a73
change back to debug
sandreim Dec 8, 2023
bc46646
Merge branch 'sandreim/subsystem-bench' of github.com:paritytech/polk…
sandreim Dec 8, 2023
de7b5c0
Add migration v11 HostConfiguration, missed during rebasing
alexggh Dec 8, 2023
5cf522a
Fix network_protocol_versioning_subsystem_msg
alexggh Dec 8, 2023
a720892
Merge remote-tracking branch 'origin/alexaggh/feature/approve_multipl…
alexggh Dec 11, 2023
b2eb712
Merge remote-tracking branch 'origin/master' into subsystem-bench-wit…
alexggh Dec 11, 2023
673940c
Latest master
alexggh Dec 11, 2023
dc5a72c
use prometheus network stats
sandreim Dec 11, 2023
3cf90e2
Fix GetApprovalSignatures
alexggh Dec 11, 2023
60516d0
Add hacks for getapproval signatures
alexggh Dec 11, 2023
83a7325
Fix GetApprovalSignatures
alexggh Dec 11, 2023
6af2910
Merge remote-tracking branch 'origin/master' into feature/approve_mul…
alexggh Dec 11, 2023
4d33c9d
Fix formatting issues
alexggh Dec 11, 2023
30950d2
Fixup cargo fmt
alexggh Dec 11, 2023
593b82a
Fix some logging messed during rebase
alexggh Dec 11, 2023
f8f03e5
Add prdoc
alexggh Dec 11, 2023
8099c16
Fixup 0002-upgrade-node failures
alexggh Dec 12, 2023
ba50d4a
Merge branch 'feature/approve_multiple_candidates_polkadot_sdk_v4' in…
alexggh Dec 12, 2023
0bc7e5f
WIP
sandreim Dec 12, 2023
dc4b2f9
Fix something here and there
alexggh Dec 13, 2023
d6b0eda
Add test message
alexggh Dec 13, 2023
1ed7620
Approval coalescing serialization
alexggh Dec 14, 2023
c77f428
Approval-voting with serialization of messages
alexggh Dec 14, 2023
27f6368
Same tranche
alexggh Dec 15, 2023
b223f6a
Latest rafector
alexggh Dec 19, 2023
a441c40
Merge remote-tracking branch 'origin/master' into subsystem-bench-wit…
alexggh Dec 19, 2023
40ef9d5
More optimizations
alexggh Dec 20, 2023
775bb58
Merge remote-tracking branch 'origin/master' into subsystem-bench-wit…
alexggh Dec 20, 2023
b4afb81
Refactoring
alexggh Dec 22, 2023
28e19f8
Add new files
alexggh Dec 22, 2023
0bfc13e
Fixup some other stuff
alexggh Dec 22, 2023
8d8de39
Address some other fixups
alexggh Dec 22, 2023
e6d6a71
Merge remote-tracking branch 'origin/master' into subsystem-bench-wit…
alexggh Dec 22, 2023
366e267
Fixup stuff
alexggh Dec 22, 2023
290eef2
Clippy
alexggh Dec 22, 2023
ba46184
complete networking refactor
sandreim Dec 28, 2023
1dfb263
refactor NetworkMessage
sandreim Jan 5, 2024
6b94648
Merge remote-tracking branch 'origin/master' into subsystem-bench-wit…
alexggh Jan 8, 2024
f7a2948
Run in CI
alexggh Jan 8, 2024
272280b
Add throughput scenarios
alexggh Jan 8, 2024
794a9b8
Fix clippy unused
alexggh Jan 8, 2024
34c60ba
Retrigger CI
alexggh Jan 8, 2024
4c9205e
Add benchamarks
alexggh Jan 9, 2024
9fbb29d
Fixup channel size
alexggh Jan 10, 2024
87892fd
refactor
sandreim Jan 10, 2024
6d5b1d8
Merge remote-tracking branch 'origin/master' into sandreim/availabili…
alexggh Jan 11, 2024
07104c9
Merge branch 'sandreim/availability-write-bench-rebased-on-master' in…
alexggh Jan 11, 2024
3d80227
Fix warnings
alexggh Jan 12, 2024
c47a96f
Cleanup1
alexggh Jan 12, 2024
9514b47
Fix running on a versi node
alexggh Jan 12, 2024
83709af
Add label to wait_until_metric_ge
alexggh Jan 12, 2024
57714db
Fixup run
alexggh Jan 12, 2024
21f3645
Fixup clippy
alexggh Jan 15, 2024
2a146f0
Cargo fmt
alexggh Jan 15, 2024
22a1bf9
Finish network refactoring and fix benchmarks
sandreim Jan 17, 2024
196c426
update examples
sandreim Jan 17, 2024
b2b41cf
Merge branch 'master' of github.com:paritytech/polkadot-sdk into sand…
sandreim Jan 17, 2024
7d63bd9
merge fixes
sandreim Jan 17, 2024
67c4c1e
clippy & fmt
sandreim Jan 17, 2024
8c00d70
fix print
sandreim Jan 17, 2024
f839f77
Fix block time
sandreim Jan 17, 2024
b6807f2
Merge branch 'master' of github.com:paritytech/polkadot-sdk into sand…
sandreim Jan 17, 2024
48508ba
clippy
sandreim Jan 17, 2024
28d9f77
Fix ASCII art
sandreim Jan 17, 2024
951f103
Merge remote-tracking branch 'origin/sandreim/availability-write-benc…
alexggh Jan 18, 2024
ca6eb18
Addressing review feedback
alexggh Jan 19, 2024
11e6dc1
Fixes
alexggh Jan 22, 2024
fad5df0
Merge remote-tracking branch 'origin/master' into subsystem-bench-app…
alexggh Jan 26, 2024
7e06da2
Merge remote-tracking branch 'origin/master' into subsystem-bench-app…
alexggh Jan 29, 2024
2721a42
Minor fixes
alexggh Jan 29, 2024
296f7e7
Fix toml format
alexggh Jan 30, 2024
bab7aa1
Remove commented code
alexggh Jan 30, 2024
d84a335
Merge remote-tracking branch 'origin/master' into alexaggh/subsystem-…
alexggh Feb 2, 2024
459a628
Remove unused property
alexggh Feb 2, 2024
73fe675
Address review findings
alexggh Feb 2, 2024
c5cb34f
Fixup
alexggh Feb 2, 2024
8fe7026
Configurable session_index in mock
alexggh Feb 2, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions polkadot/node/subsystem-bench/Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -68,14 +68,14 @@ prometheus = { version = "0.13.0", default-features = false }
serde = "1.0.195"
serde_yaml = "0.9"

polkadot-node-core-approval-voting = { path = "../core/approval-voting"}
polkadot-approval-distribution = {path = "../network/approval-distribution"}
polkadot-node-core-approval-voting = { path = "../core/approval-voting" }
alexggh marked this conversation as resolved.
Show resolved Hide resolved
polkadot-approval-distribution = { path = "../network/approval-distribution" }
sp-consensus-babe = { path = "../../../substrate/primitives/consensus/babe" }
sp-runtime = { path = "../../../substrate/primitives/runtime", default-features = false }
sp-timestamp = { path = "../../../substrate/primitives/timestamp" }

schnorrkel = { version = "0.9.1", default-features = false }
rand_core = "0.6.2" # should match schnorrkel
rand_core = "0.6.2" # should match schnorrkel
rand_chacha = { version = "0.3.1" }
paste = "1.0.14"
orchestra = { version = "0.3.4", default-features = false, features = ["futures_channel"] }
Expand Down
Loading