Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TESTING] Script for benchmarking builders locally #137

Open
wants to merge 78 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 64 commits
Commits
Show all changes
78 commits
Select commit Hold shift + click to select a range
2a2511d
Runner script (#1)
OlegJakushkin Oct 19, 2023
00ba47b
Update builder metrics flags
cbermudez97 Oct 19, 2023
d032267
fix: update metrics flags
cbermudez97 Oct 19, 2023
b5b1d20
feat: update dashboard tooltips
cbermudez97 Oct 19, 2023
141ce8e
feat: use ethereum package main branch
cbermudez97 Oct 19, 2023
b8d791c
feat: use version 0.6.1 with builder fix
cbermudez97 Oct 20, 2023
124cd55
updated build script
OlegJakushkin Oct 23, 2023
4b58a8f
Increase the number of generated transactions. Update custom flood co…
piwonskp Oct 24, 2023
a110e8b
Fix additional builder metrics flags (#3)
cbermudez97 Oct 24, 2023
6cf4f91
Fix builders not submitting blocks. Use geth as it appear to deliver…
piwonskp Oct 27, 2023
40ac12b
Update issue templates
kamilchodola Oct 30, 2023
4765df9
Revert "Update issue templates"
kamilchodola Oct 30, 2023
35fc869
feat: update old dashboard panels
cbermudez97 Oct 30, 2023
b6b0eae
feat: add smaller dashboard for builders comparisson
cbermudez97 Oct 30, 2023
d3ec936
Merge pull request #4 from NethermindEth/fix-txs-not-peered
piwonskp Oct 31, 2023
64fc940
Change URL for Kurtosis install (#5)
kamilchodola Oct 31, 2023
30c2139
chore: merge branch 'main' into dashboards-improvements
cbermudez97 Oct 31, 2023
67bef29
feat: use ethereum package version 1.0.0
cbermudez97 Oct 31, 2023
d9afb54
fix: revert "feat: use ethereum package version 1.0.0"
cbermudez97 Oct 31, 2023
25b0784
Merge branch 'main' into dashboards-improvements
cbermudez97 Nov 1, 2023
755cce2
feat: add additional prometheus labels
cbermudez97 Nov 1, 2023
713bc18
feat: update labels in dashboards
cbermudez97 Nov 1, 2023
b91f222
feat: centralize dashboards and apply custom prometheus config
cbermudez97 Nov 2, 2023
0e8f484
fix: wrong prometheus config values
cbermudez97 Nov 2, 2023
1e0ca5e
Merge remote-tracking branch 'origin/dashboards-improvements' into main
OlegJakushkin Nov 7, 2023
333d014
tested dind
OlegJakushkin Nov 7, 2023
591d8e3
fix: wrong units for slots on blocks build time
cbermudez97 Nov 7, 2023
480d3df
feat: update ethereum package branch
cbermudez97 Nov 8, 2023
e607941
Use broadcaster instead of peering between builders
piwonskp Nov 9, 2023
5ed3ba5
Merge remote-tracking branch 'origin/broadcaster' into dashboards-imp…
cbermudez97 Nov 9, 2023
06a35e2
Use ethereum-package main branch and a newer version of nethermind cl…
piwonskp Nov 9, 2023
e985a43
Merge remote-tracking branch 'origin/broadcaster' into dashboards-imp…
cbermudez97 Nov 9, 2023
51ade5b
feat: improve dashboard and reduce slot time
cbermudez97 Nov 9, 2023
daeb9dd
feat: allow to disable epoch 4 annotation
cbermudez97 Nov 9, 2023
029dd54
fix: wrong value mappings
cbermudez97 Nov 9, 2023
deb051e
Add slot Time
kamilchodola Nov 9, 2023
cd6bff9
Add missing usage
kamilchodola Nov 9, 2023
27fa340
feat: add bids built count
cbermudez97 Nov 9, 2023
8a3d7e8
Started finetuning fore public ports on eth package
OlegJakushkin Nov 10, 2023
0a21923
Merge remote-tracking branch 'origin/kch/add_slot_time' into main
OlegJakushkin Nov 10, 2023
5cfcc17
Partial enclave stop and progress monitoring
OlegJakushkin Nov 10, 2023
ff4fb5f
Merge pull request #7 from NethermindEth/broadcaster
piwonskp Nov 10, 2023
5f67305
Merge pull request #8 from NethermindEth/dashboards-improvements
kamilchodola Nov 10, 2023
f3b8bfe
Merge pull request #9 from NethermindEth/kch/add_slot_time
kamilchodola Nov 10, 2023
fd6bfc8
Merge branch 'main' into partial-stop
kamilchodola Nov 10, 2023
dbe6a31
Merge pull request #10 from NethermindEth/partial-stop
kamilchodola Nov 10, 2023
78c61e0
Set dev builder image tag as `dev`
piwonskp Nov 10, 2023
720c2e8
Merge pull request #11 from NethermindEth/piwonskp/change-dev-builder…
kamilchodola Nov 10, 2023
69ffbe0
Fix linting
kamilchodola Nov 12, 2023
cd2c2f4
Adjust references
kamilchodola Nov 12, 2023
cd2b117
Merge pull request #12 from NethermindEth/kch/lint
kamilchodola Nov 12, 2023
ded84f9
Fix readme, change -s to 1000 and improve summary
kamilchodola Nov 12, 2023
c3f2274
Fix method def
kamilchodola Nov 12, 2023
af74e21
Merge pull request #13 from NethermindEth/kch/adjust_default_slot_number
kamilchodola Nov 12, 2023
8f905f3
Pretty print service urls
piwonskp Nov 13, 2023
a3498e0
Add third builder - relay validator
piwonskp Nov 14, 2023
1260c63
Print exact url of the dashboard, not the grafana service root
piwonskp Nov 15, 2023
487bae4
Use latest versions of lighthouse and nethermind & fix baseline extra…
piwonskp Nov 15, 2023
58af272
Change the prometheus label so validator is not visible on the dashboard
piwonskp Nov 15, 2023
bdeb000
Use default lighthouse image
piwonskp Nov 16, 2023
463fbfd
Merge pull request #14 from NethermindEth/bold-service-urls
piwonskp Nov 16, 2023
354ef10
Merge pull request #15 from NethermindEth/three-builders
kamilchodola Nov 17, 2023
c440fa5
Using default Dockerfile for build (#16)
OlegJakushkin Nov 17, 2023
c2cf45d
Add architecture diagram
piwonskp Nov 17, 2023
b783bfa
Increase fuzzing rate
piwonskp Nov 18, 2023
240b202
Merge pull request #17 from NethermindEth/increase-fuzzing-rate
piwonskp Nov 19, 2023
db9578c
Uppercase readme
kamilchodola Nov 21, 2023
9ef02d2
Merge remote-tracking branch 'origin/main' into dind
OlegJakushkin Nov 24, 2023
475e6c7
clean up dind docs
OlegJakushkin Nov 24, 2023
b3cb7c0
added wip disclamer
OlegJakushkin Nov 24, 2023
02fea33
fix diff with main
OlegJakushkin Nov 24, 2023
cc3f7bb
fix distance to main
OlegJakushkin Nov 24, 2023
d32645f
Update scripts/README.md
piwonskp Nov 24, 2023
c824177
Update scripts/README.md
piwonskp Nov 24, 2023
f488a4f
Merge pull request #18 from NethermindEth/dind
piwonskp Nov 24, 2023
8fc222a
Add dashboard and architecture description to the readme
piwonskp Nov 24, 2023
6e617c2
Fix links to fuzzeers
piwonskp Nov 24, 2023
3cee741
Rename readme -> README
piwonskp Dec 3, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -48,4 +48,5 @@ profile.cov

**/yarn-error.log
/ofac_blacklist.json
/blacklist.json
/blacklist.json
scripts/kurtosis/network_params_tmp.json
34 changes: 34 additions & 0 deletions scripts/Dockerfile.debug
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
# Support setting various labels on the final image
ARG COMMIT=""
ARG VERSION=""
ARG BUILDNUM=""

# Build Geth in a stock Go builder container
FROM golang:1.20-alpine as builder

RUN apk add --no-cache gcc musl-dev linux-headers git

# Get dependencies - will also be cached if we won't change go.mod/go.sum
COPY go.mod /go-ethereum/
COPY go.sum /go-ethereum/
RUN cd /go-ethereum && go mod download

ADD . /go-ethereum

RUN cd /go-ethereum && go build -o ./build/bin/geth -gcflags=all='-N -l' -v ./cmd/geth

RUN go install github.com/go-delve/delve/cmd/dlv@latest
# Pull Geth into a second stage deploy alpine container
FROM alpine:latest

RUN apk add --no-cache ca-certificates
COPY --from=builder /go-ethereum/build/bin/geth /usr/local/bin/
COPY --from=builder /go/bin/dlv /
EXPOSE 8545 8546 30303 30303/udp 40000
ENTRYPOINT ["/dlv", "--listen=:40000", "--headless=true", "--continue", "--accept-multiclient", "--api-version=2", "exec", "/usr/local/bin/geth"]
# Add some metadata labels to help programatic image consumption
ARG COMMIT=""
ARG VERSION=""
ARG BUILDNUM=""

LABEL commit="$COMMIT" version="$VERSION" buildnum="$BUILDNUM"
20 changes: 20 additions & 0 deletions scripts/dind/Dockerfile.kurtosis_dind
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
FROM mcr.microsoft.com/devcontainers/base:bullseye

# Get Go
RUN apt install git curl tar && \
curl https://dl.google.com/go/go1.21.3.linux-amd64.tar.gz -o go.tar.gz && \
tar -C /usr/local -xzf go.tar.gz && \
rm go.tar.gz

# Set up Go environment variables
ENV GOPATH /go
ENV PATH $GOPATH/bin:/usr/local/go/bin:$PATH
RUN mkdir -p "$GOPATH/src" "$GOPATH/bin" && chmod -R 777 "$GOPATH"

# Install Kurtosis
RUN echo "deb [trusted=yes] https://apt.fury.io/kurtosis-tech/ /" | tee /etc/apt/sources.list.d/kurtosis.list
RUN sudo apt update && \
sudo apt install kurtosis-cli

WORKDIR /geth
COPY ../ .
Loading
Loading