Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ASTS] Two Task Runnables: Prototype #7211

Open
wants to merge 35 commits into
base: jkong/bucket-storage-vi
Choose a base branch
from

Conversation

jeremyk-91
Copy link
Contributor

This is just a prototype. It has a sketch of the implementations for

  • the foreground task (DefaultSingleBucketSweepTask), BUT NOT any of the infrastructure around the orchestration or scheduling of instances of the task
  • the background task (DefaultGlobalSweepProgressUpdatingTask), again nothing that runs it.

It has no tests 😬 Obviously, we'll add this when merging the PRs more concretely.

I thought this was a good way to flesh out some of the designs discussed on the RFCs.

I am not filling in the template, as this PR is not intended to be merged in its current form.

sweepTimestampForIteration,
SweepQueueUtils.minTsForFinePartition(sweepableBucket.bucketIdentifier() + 1));

// TODO (jkong): Don't just use this, it does a lot of unnecessary stuff
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The intention here was because buckets used to be perfectly aligned on partition boundaries. This is no longer the case, and so this is necessary

@jeremyk-91 jeremyk-91 force-pushed the jkong/bucket-storage-vi branch 2 times, most recently from 08f3e1a to 4122a98 Compare September 6, 2024 19:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants