Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Add GCP BigTable support #364

Merged
merged 79 commits into from
Aug 2, 2023
Merged

feat: Add GCP BigTable support #364

merged 79 commits into from
Aug 2, 2023

Commits on Mar 29, 2023

  1. feat: Add GCP BigTable support 

    WIP: code in place, needs testing and validation
    @jrconlin
    jrconlin committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    03a3ddb View commit details
    Browse the repository at this point in the history

  2. f enable openssl for grpcio for now

    @jrconlin
    jrconlin committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    cbd2697 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2023

  1. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed Apr 10, 2023
    Configuration menu
    Copy the full SHA
    700c94c View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2023

  1. f add docs, tweak the circleci config

    @jrconlin
    jrconlin committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    18b782b View commit details
    Browse the repository at this point in the history

  2. f more notes about initializing bigtable

    @jrconlin
    jrconlin committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    408cfb1 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2023

  1. f move bigtable under a feature flag to allow for ci to continue

    @jrconlin
    jrconlin committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    1e3db74 View commit details
    Browse the repository at this point in the history

  2. f fmt

    @jrconlin
    jrconlin committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    5dd6b8c View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2023

  1. f nightly checkin (start emulator tests for bigtable)

    @jrconlin
    jrconlin committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    da1bb43 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2023

  1. f got emulated connections working with bigtable

    @jrconlin
    jrconlin committed Apr 17, 2023
    Configuration menu
    Copy the full SHA
    426b158 View commit details
    Browse the repository at this point in the history

  2. f bump the resource size to x-large

    @jrconlin
    jrconlin committed Apr 17, 2023
    Configuration menu
    Copy the full SHA
    7ceb7da View commit details
    Browse the repository at this point in the history

  3. f typo

    @jrconlin
    jrconlin committed Apr 17, 2023
    Configuration menu
    Copy the full SHA
    315ea5a View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2023

  1. f it works!

    @jrconlin
    jrconlin committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    6411a54 View commit details
    Browse the repository at this point in the history

  2. f refactor to use sort key for message storage 

    After sleeping on it, I decided to not overload the messages being
stored when possible.
    @jrconlin
    jrconlin committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    35f5959 View commit details
    Browse the repository at this point in the history

  3. f update README to include maxage and versions

    @jrconlin
    jrconlin committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    86987c3 View commit details
    Browse the repository at this point in the history

  4. f forgot to turn off the emulator testing

    @jrconlin
    jrconlin committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    1f3fd7d View commit details
    Browse the repository at this point in the history

  5. f audit

    @jrconlin
    jrconlin committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    d0bff2b View commit details
    Browse the repository at this point in the history

  6. f comments

    @jrconlin
    jrconlin committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    c8f39ba View commit details
    Browse the repository at this point in the history

  7. f clippy

    @jrconlin
    jrconlin committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    c1600f5 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2023

  1. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    5d0f1a8 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2023

  1. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    d838d68 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2023

  1. Merge branch 'master' into feat/big_table

    @jrconlin
    jrconlin committed May 2, 2023
    Configuration menu
    Copy the full SHA
    c5b0f82 View commit details
    Browse the repository at this point in the history

  2. feat: Fill out more of the core autoconnect functions 

    * add proper health check routine for __status__
    @jrconlin
    jrconlin committed May 2, 2023
    Configuration menu
    Copy the full SHA
    53b9bec View commit details
    Browse the repository at this point in the history

  3. f clippy

    @jrconlin
    jrconlin committed May 2, 2023
    Configuration menu
    Copy the full SHA
    10f0a6c View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feat/autoconnect' into feat/big_table

    @jrconlin
    jrconlin committed May 2, 2023
    Configuration menu
    Copy the full SHA
    658673d View commit details
    Browse the repository at this point in the history

Commits on May 3, 2023

  1. f backport the connection check logic, since it's kinda useful.

    @jrconlin
    jrconlin committed May 3, 2023
    Configuration menu
    Copy the full SHA
    408d1e1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feat/big_table' of github.com:mozilla-services/autopush… 

    …-rs into feat/big_table
    @jrconlin
    jrconlin committed May 3, 2023
    Configuration menu
    Copy the full SHA
    8694eb4 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2023

  1. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed May 17, 2023
    Configuration menu
    Copy the full SHA
    af2868f View commit details
    Browse the repository at this point in the history

  2. feat: complete (mostly) the WebPushClient 

    SYNC-3688
    @pjenvey
    pjenvey committed May 17, 2023
    Configuration menu
    Copy the full SHA
    033bef4 View commit details
    Browse the repository at this point in the history

  3. chore: run the integration tests against autoconnect in ci 

    but ignore the 4 current failures

SYNC-3688
    @pjenvey
    pjenvey committed May 17, 2023
    Configuration menu
    Copy the full SHA
    50e9d12 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2023

  1. Merge branch 'feat/sm-storage-SYNC-3688' into feat/big_table

    @jrconlin
    jrconlin committed May 19, 2023
    Configuration menu
    Copy the full SHA
    db663a4 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2023

  1. f bump python requests for CVE-2023-32681

    @jrconlin
    jrconlin committed May 23, 2023
    Configuration menu
    Copy the full SHA
    31fe58e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed May 23, 2023
    Configuration menu
    Copy the full SHA
    63cba97 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2023

  1. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed May 30, 2023
    Configuration menu
    Copy the full SHA
    be82298 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed May 30, 2023
    Configuration menu
    Copy the full SHA
    c18221a View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2023

  1. Merge branch 'master' into feat/big_table

    @jrconlin
    jrconlin committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    b4c7fdf View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2023

  1. feat: remove legacy table rotation 

    SYNC-3741
    @pjenvey
    pjenvey committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    31fe558 View commit details
    Browse the repository at this point in the history

  2. refactor: kill no longer used hello, etc and prototype client.rs

    @pjenvey
    pjenvey committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    36c56a5 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2023

  1. Merge branch 'feat/message-rotation-SYNC-3741' of github.com:mozilla-… 

    …services/autopush-rs into feat/big_table
    @jrconlin
    jrconlin committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    e566501 View commit details
    Browse the repository at this point in the history

  2. f pre-emptive merge of #389

    @jrconlin
    jrconlin committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    c1bcd42 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    233d14a View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feat/big_table' of github.com:mozilla-services/autopush… 

    …-rs into feat/big_table
    @jrconlin
    jrconlin committed Jun 14, 2023
    Configuration menu
    Copy the full SHA
    c05b787 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. feat: make DbClient's message table month optional 

    (for BigTable)

also:
- kill save_channels (only needed by legacy autoconnect)
- update mockall/cleanup old workaround
- update openssl per RUSTSEC-2023-0044

SYNC-3449
    @pjenvey
    pjenvey committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    89d0d99 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feat/optional-rotating-message-table-SYNC-3449' of gith… 

    …ub.com:mozilla-services/autopush-rs into feat/big_table
    @jrconlin
    jrconlin committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    7209235 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    61aea24 View commit details
    Browse the repository at this point in the history

  4. f typo

    @jrconlin
    jrconlin committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    1a5bf93 View commit details
    Browse the repository at this point in the history

  5. f fmt

    @jrconlin
    jrconlin committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    9948686 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. f nightly 

    * fix features propagation
* report available storage types
* fix integration test to possibly use bigtable stuff.
  * added demo script for running bigtable integration tests
  * includes semi-hacky bt_test.json table settings because escaping json is a pain
  * pass "emulator" feature if bigtable detected (will strip later)
    @jrconlin
    jrconlin committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    880d63f View commit details
    Browse the repository at this point in the history

  2. f pjenvey's rust fixes

    @jrconlin
    jrconlin committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    54c2832 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2023

  1. f nightly (integration test still not working)

    @jrconlin
    jrconlin committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    acb159a View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2023

  1. f make current_timestamp more explicit. 

    TODO: s/current_timestamp/last_notification_timestamp/g
    @jrconlin
    jrconlin committed Jun 30, 2023
    Configuration menu
    Copy the full SHA
    22027fa View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed Jun 30, 2023
    Configuration menu
    Copy the full SHA
    8ef6ee9 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2023

  1. Merge branch 'master' into feat/big_table

    @jrconlin
    jrconlin committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    226eb4f View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2023

  1. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    0d2aac2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feat/big_table' of github.com:mozilla-services/autopush… 

    …-rs into feat/big_table
    @jrconlin
    jrconlin committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    6c02331 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. feat: Topic messages shouldn't have sortkey_timestamps 

    - fix autoconnect's db initialization to match autoendpoint's (don't panic when
no DB_DSN is set)

- don't unnecessarily remove expired messages in a background task during check
  storage

SYNC-3777
SYNC-3809
    @pjenvey
    pjenvey committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    6d8a0f7 View commit details
    Browse the repository at this point in the history

  2. f nightly

    @jrconlin
    jrconlin committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    49628cb View commit details
    Browse the repository at this point in the history

  3. Merge branch 'fix/topic-sortkey_timestamp-SYNC-3809' of github.com:mo… 

    …zilla-services/autopush-rs into feat/big_table
    @jrconlin
    jrconlin committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    293d327 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2023

  1. f broken: get_topic_expired finding expired topic message? 

    * There's a lot more debugging
    @jrconlin
    jrconlin committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    6e80f76 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2023

  1. f nightly

    @jrconlin
    jrconlin committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    55fd58f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    8f45254 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    18abe53 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feat/big_table' of github.com:mozilla-services/autopush… 

    …-rs into feat/big_table
    @jrconlin
    jrconlin committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    7a9cfc9 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. f fix tests 

    * Add a marker to the test_ttl data check
    @jrconlin
    jrconlin committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    43fb63d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    86c9947 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. Merge branch 'master' into feat/big_table

    @jrconlin
    jrconlin committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    4d4928f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into feat/big_table

    @jrconlin
    jrconlin committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    4f5edbe View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into feat/big_table

    @jrconlin
    jrconlin committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    601d5e9 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. f r's

    @jrconlin
    jrconlin committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    43a446e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feat/big_table' of github.com:mozilla-services/autopush… 

    …-rs into feat/big_table
    @jrconlin
    jrconlin committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    d4ca175 View commit details
    Browse the repository at this point in the history

  3. f fix config.yml

    @jrconlin
    jrconlin committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    3dc6d2b View commit details
    Browse the repository at this point in the history

  4. f switch to standard dynamodb

    @jrconlin
    jrconlin committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    800534e View commit details
    Browse the repository at this point in the history

  5. f with jobs=8

    @jrconlin
    jrconlin committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    0434055 View commit details
    Browse the repository at this point in the history

  6. f fix circleci ddb flags

    @jrconlin
    jrconlin committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    b298716 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. f r's

    @jrconlin
    jrconlin committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    8dd5a68 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:mozilla-services/autopush-rs into… 

    … feat/big_table
    @jrconlin
    jrconlin committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    e67acda View commit details
    Browse the repository at this point in the history

  3. f run test with features=bigtable

    @jrconlin
    jrconlin committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    1e28e0c View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. f force allow(unused_mut), dangit.

    @jrconlin
    jrconlin committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    bdd90ff View commit details
    Browse the repository at this point in the history

  2. f take the g'd changes

    @jrconlin
    jrconlin committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    36daa62 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. f add back limiter

    @jrconlin
    jrconlin committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    062527f View commit details
    Browse the repository at this point in the history