Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regression Benchmarking #2

Open
j-mie6 opened this issue Sep 6, 2023 · 0 comments
Open

Regression Benchmarking #2

j-mie6 opened this issue Sep 6, 2023 · 0 comments

Comments

@j-mie6
Copy link
Owner

j-mie6 commented Sep 6, 2023

As we build more and more functionality into the library, it would be a good idea to make sure that we don't do anything that inadvertently cripples the efficiency. I propose the following:

  1. Write a selection of benchmarks using tasty-bench as a test suite (these will also be able to serve as integration tests!)
  2. If the commit is tagged write these results to a .csv file, and push them into a bench-data branch under tag.csv
  3. On push, if there is a previous tag on this branch (or main) pull down the csv file for that tag, and use it as a comparison, allowing us to test that things don't deviate too much.

Some resources on this:

This was referenced Sep 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant