-
Notifications
You must be signed in to change notification settings - Fork 577
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Transactions: remove expired abort indexes #5556
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good overall. I am asking for some python type annotations then this should be ready to go.
Once a log was evicted up to an offset X it's wasteful to store abort indexes covering the offsets before X (the abort index is used only for the existing offsets). The commit drops the expired abort indexes during the snapshot procedure.
707fb68
to
0ba5edc
Compare
Build failure: #5868 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@rystsov PR looks good to me!
but I think there is a potential race condition that could lead to a segfault. where the race is possible or is protected against some how is not clear. could you take a look? i left a comment with the concern.
0ba5edc
to
fb64e73
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
there is a linter error
fb64e73
to
b3fd299
Compare
not anymore |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Patch looks ok to me if we decided not to make any changes to in-memory representation... one last question about implications to shadow indexing relying on this data.
b3fd299
to
adcc440
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
looks good. just a couple questions
Cover letter
Once a log was evicted up to an offset X it's wasteful to store abort indexes covering the offsets before X (the abort index is used only for the existing offsets). The commit drops the expired abort indexes during the snapshot procedure.
Release notes