Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Background API #971

Merged
merged 66 commits into from
Jan 27, 2022
Merged

Background API #971

merged 66 commits into from
Jan 27, 2022

Commits on Jan 26, 2022

  1. every go routine needs to have its own collection factory 

    this is needed so concurrent reads and writes are possible.
    @lbolla
    Oliver Sauder authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    caf1cf1 View commit details
    Browse the repository at this point in the history

  2. Removed obsolete RWMutexes

    @lbolla
    Oliver Sauder authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    af48597 View commit details
    Browse the repository at this point in the history

  3. Database changes of resources need to be atomic

    @lbolla
    Oliver Sauder authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    ae8910d View commit details
    Browse the repository at this point in the history

  4. db batch may not be a global resource 

    This way db usage is safe.
    @lbolla
    Oliver Sauder authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    483beef View commit details
    Browse the repository at this point in the history

  5. Solving progress not safe issue for api 

    Progress is not safe so for api its always nil and
code needs to take care of this
    @lbolla
    Oliver Sauder authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    7476937 View commit details
    Browse the repository at this point in the history

  6. Fixed not running tests

    @lbolla
    Oliver Sauder authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    5fc97f1 View commit details
    Browse the repository at this point in the history

  7. Add task api and resource locking ability

    @lbolla
    Oliver Sauder authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    f0ea727 View commit details
    Browse the repository at this point in the history

  8. Added mirror api based on task list

    @lbolla
    Oliver Sauder authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    92b30a7 View commit details
    Browse the repository at this point in the history

  9. Added gpg api so mirror updates are fully functional from api

    @lbolla
    Oliver Sauder authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    0268b10 View commit details
    Browse the repository at this point in the history

  10. Combine publish list progress into one

    @lbolla
    Oliver Sauder authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    67beea6 View commit details
    Browse the repository at this point in the history

  11. Add publish output progress counting remaining number of packages

    @lbolla
    Oliver Sauder authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    0aa85a0 View commit details
    Browse the repository at this point in the history

  12. Add db cleanup api

    @lbolla
    Oliver Sauder authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    1a3d7e3 View commit details
    Browse the repository at this point in the history

  13. log download retries

    @neolynx @lbolla
    neolynx authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    62bcc7f View commit details
    Browse the repository at this point in the history

  14. api: allow renaming repos

    @neolynx @lbolla
    neolynx authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    67eb248 View commit details
    Browse the repository at this point in the history

  15. fix gpg keys

    @neolynx @lbolla
    neolynx authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    2f937ef View commit details
    Browse the repository at this point in the history

  16. Use verifier from context

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    93f6589 View commit details
    Browse the repository at this point in the history

  17. api gpg: show gpg command

    @neolynx @lbolla
    neolynx authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    64893c1 View commit details
    Browse the repository at this point in the history

  18. mirror: increase logging for easier debugging

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    a051213 View commit details
    Browse the repository at this point in the history

  19. mirror: interrupt goroutine when done 

    This should avoid deadlocking when context is destroyed.
    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    759d517 View commit details
    Browse the repository at this point in the history

  20. mirror: add more logging

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    09a8647 View commit details
    Browse the repository at this point in the history

  21. gpg: fix downloading multiple keys 

    each key needs to be provided as separate argument to gpg1 --recv-keys
    @neolynx @lbolla
    neolynx authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    1ab367a View commit details
    Browse the repository at this point in the history

  22. Sleep between retries to download from http 

    Fix #1
    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    d28c9b7 View commit details
    Browse the repository at this point in the history

  23. Cap delay to sleep to avoid overflow

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    43c28ba View commit details
    Browse the repository at this point in the history

  24. Don't use transactions when direct db access is enough 

    For read-only action transactions are not necessary and they risk to deadlock
if multiple go-routines try to read the database.
    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    236a8ad View commit details
    Browse the repository at this point in the history

  25. Fix syntax error

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    4f0342b View commit details
    Browse the repository at this point in the history

  26. Add new AUTHORS

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    273d028 View commit details
    Browse the repository at this point in the history

  27. Configurable background task execution

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    220e45e View commit details
    Browse the repository at this point in the history

  28. Use global async flag as fallback on per-request flag 

    This way, if no pre-request flag is specified, the globally configured default
is used.
    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    4c5b40f View commit details
    Browse the repository at this point in the history

  29. More informative return value for task.Process

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    2a0aacc View commit details
    Browse the repository at this point in the history

  30. Fix system tests

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    02c11dc View commit details
    Browse the repository at this point in the history

  31. Fix indentation

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    525b2a1 View commit details
    Browse the repository at this point in the history

  32. Fix rebase

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    94c173c View commit details
    Browse the repository at this point in the history

  33. Fix unittests

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    1f36620 View commit details
    Browse the repository at this point in the history

  34. Fix pure-go unittests 

    So they can run on e.g. LXC containers as root, or other conceivable setups.
    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    f511731 View commit details
    Browse the repository at this point in the history

  35. Make truthy function less surprising

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    76963fb View commit details
    Browse the repository at this point in the history

  36. Use newer golangci-lint source as the former is abandoned.

    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    d196400 View commit details
    Browse the repository at this point in the history

  37. Workaround differences in the GHA Ubuntu 18.04 environment compared t… 

    …o the Travis CI Ubuntu 16.04 environment.
    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    49f4945 View commit details
    Browse the repository at this point in the history

  38. Initial attempt at a GitHub Actions workflow to emulate the previousl… 

    …y used Travis CI setup.
    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    786f8ca View commit details
    Browse the repository at this point in the history

  39. Fix syntax error.

    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    8f95474 View commit details
    Browse the repository at this point in the history

  40. Matrix elements must be arrays.

    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    d78e3b1 View commit details
    Browse the repository at this point in the history

  41. continue-on-error value must be a boolean

    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    2e18eae View commit details
    Browse the repository at this point in the history

  42. Disable testing against Go master for now.

    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    58075e5 View commit details
    Browse the repository at this point in the history

  43. golint: "Json" in func name should be "JSON".

    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    cace05d View commit details
    Browse the repository at this point in the history

  44. golint: "Json" in func name should be "JSON".

    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    6672ef4 View commit details
    Browse the repository at this point in the history

  45. govet: compose literal uses unkeyed fields

    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    4023020 View commit details
    Browse the repository at this point in the history

  46. govet: compose literal uses unkeyed fields

    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    356bc9f View commit details
    Browse the repository at this point in the history

  47. Add a comment referring to the original Travis CI config from the new… 

    … workflow.
    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    303c011 View commit details
    Browse the repository at this point in the history

  48. govet: compose literal uses unkeyed fields

    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    63dc24c View commit details
    Browse the repository at this point in the history

  49. govet: compose literal uses unkeyed fields

    @ximon18 @lbolla
    ximon18 authored and lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    01627e3 View commit details
    Browse the repository at this point in the history

  50. Fix linting errors

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    04bf92a View commit details
    Browse the repository at this point in the history

  51. Fix flake8 lint errors

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    adf978e View commit details
    Browse the repository at this point in the history

  52. Fix some failing system tests

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    e2d2a2d View commit details
    Browse the repository at this point in the history

  53. Try to fix test failing on CI 

    PublishRepo26Test fails to run because something in the CI environment forces
gpg to ask for the user's password. Try to require gpg1 for the test, which
seems to run fine in other environments.
    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    60cdcba View commit details
    Browse the repository at this point in the history

  54. Temporarily skip test failing on CI

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    4d62266 View commit details
    Browse the repository at this point in the history

  55. Fix test after merge

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    bd3dd23 View commit details
    Browse the repository at this point in the history

  56. Trigger CI on every push

    @randombenj
    randombenj committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    27fac43 View commit details
    Browse the repository at this point in the history

  57. Build for newer go versions

    @randombenj
    randombenj committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    613003b View commit details
    Browse the repository at this point in the history

  58. Silence unhelpful linter error 

    See #1012
    @lbolla @randombenj
    lbolla authored and randombenj committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    1d51850 View commit details
    Browse the repository at this point in the history

  59. Fix failing tests

    @lbolla @randombenj
    lbolla authored and randombenj committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    c764a62 View commit details
    Browse the repository at this point in the history

  60. Re-enable testing on go 1.17

    @lbolla @randombenj
    lbolla authored and randombenj committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    bd8507c View commit details
    Browse the repository at this point in the history

  61. Ignore dates in test

    @lbolla @randombenj
    lbolla authored and randombenj committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    dcb909d View commit details
    Browse the repository at this point in the history

  62. Typo correction in GHA workflow comment

    @ximon18
    ximon18 committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    88c36d8 View commit details
    Browse the repository at this point in the history

  63. Strip irrelevant lines from test output 

    It may happen that aptly retries to download data during tests (maybe because
of a network issue), but our fixtures doesn't account for it. So, we strip
those irrelevant lines before comparison.
    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    ca36bb5 View commit details
    Browse the repository at this point in the history

  64. Allow to check for empty output in tests

    @lbolla
    lbolla committed Jan 26, 2022
    Configuration menu
    Copy the full SHA
    67dfa02 View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2022

  1. Update minimum required go version

    @randombenj
    randombenj committed Jan 27, 2022
    Configuration menu
    Copy the full SHA
    110dba4 View commit details
    Browse the repository at this point in the history

  2. Only run system test with latest go version

    @randombenj
    randombenj committed Jan 27, 2022
    Configuration menu
    Copy the full SHA
    1e91e29 View commit details
    Browse the repository at this point in the history