Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LLaMA Implementation #21955

Closed
wants to merge 53 commits into from
Closed

LLaMA Implementation #21955

wants to merge 53 commits into from

Commits on Mar 5, 2023

  1. LLaMA

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    d7e21f6 View commit details
    Browse the repository at this point in the history

  2. sharding and docs

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    8978f28 View commit details
    Browse the repository at this point in the history

  3. tweak

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    1b4850b View commit details
    Browse the repository at this point in the history

  4. black

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    1716c4e View commit details
    Browse the repository at this point in the history

  5. inits

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    e31715d View commit details
    Browse the repository at this point in the history

  6. ruff

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    55012ec View commit details
    Browse the repository at this point in the history

  7. LLAMA_PRETRAINED_CONFIG_ARCHIVE_MAP

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    a4c89ee View commit details
    Browse the repository at this point in the history

  8. init

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    984ea75 View commit details
    Browse the repository at this point in the history

  9. no checkpoint

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    a61eae9 View commit details
    Browse the repository at this point in the history

  10. docs

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    4a9a7df View commit details
    Browse the repository at this point in the history

  11. ruff

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    39991ad View commit details
    Browse the repository at this point in the history

  12. type_vocab_size

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    a376678 View commit details
    Browse the repository at this point in the history

  13. tokenizer fixes

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    c1dae8f View commit details
    Browse the repository at this point in the history

  14. tokenizer fixes

    @zphang
    zphang committed Mar 5, 2023
    Configuration menu
    Copy the full SHA
    459e2ac View commit details
    Browse the repository at this point in the history

Commits on Mar 7, 2023

  1. Update tokenization_llama.py

    @StellaAthena
    StellaAthena committed Mar 7, 2023
    Configuration menu
    Copy the full SHA
    a82e47c View commit details
    Browse the repository at this point in the history

  2. Update tokenization_llama.py

    @StellaAthena
    StellaAthena committed Mar 7, 2023
    Configuration menu
    Copy the full SHA
    2f36c47 View commit details
    Browse the repository at this point in the history

  3. Update configuration_llama.py

    @StellaAthena
    StellaAthena committed Mar 7, 2023
    Configuration menu
    Copy the full SHA
    2a07565 View commit details
    Browse the repository at this point in the history

  4. Update modeling_llama.py

    @StellaAthena
    StellaAthena committed Mar 7, 2023
    Configuration menu
    Copy the full SHA
    331898c View commit details
    Browse the repository at this point in the history

  5. Merge pull request #2 from zphang/StellaAthena-patch-1 

    Stella athena patch 1
    @StellaAthena
    StellaAthena committed Mar 7, 2023
    Configuration menu
    Copy the full SHA
    6a17e7f View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2023

  1. tokenizer add_bos by default

    @zphang
    zphang committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    bdb7064 View commit details
    Browse the repository at this point in the history

  2. licenses

    @zphang
    zphang committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    e7c9bff View commit details
    Browse the repository at this point in the history

  3. remove decoder

    @zphang
    zphang committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    132f59b View commit details
    Browse the repository at this point in the history

  4. norms and mlp

    @zphang
    zphang committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    a786f29 View commit details
    Browse the repository at this point in the history

  5. rope overhaul

    @zphang
    zphang committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    76a9f07 View commit details
    Browse the repository at this point in the history

  6. tweaks

    @zphang
    zphang committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    5ced472 View commit details
    Browse the repository at this point in the history

  7. black

    @zphang
    zphang committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    6e7ecaf View commit details
    Browse the repository at this point in the history

  8. mention OPT implementation

    @zphang
    zphang committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    4b11ce2 View commit details
    Browse the repository at this point in the history

  9. off-by-one naming

    @zphang
    zphang committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    0209e0b View commit details
    Browse the repository at this point in the history

  10. typo

    @zphang
    zphang committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    660dd6e View commit details
    Browse the repository at this point in the history

  11. fix

    @zphang
    zphang committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    e5dd77a View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2023

  1. tokenization fix and slicing bug

    @zphang
    zphang committed Mar 9, 2023
    Configuration menu
    Copy the full SHA
    68d640f View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2023

  1. padding config

    @zphang
    zphang committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    16058fe View commit details
    Browse the repository at this point in the history

  2. cleanup

    @zphang
    zphang committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    e2faccb View commit details
    Browse the repository at this point in the history

  3. black

    @zphang
    zphang committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    84948eb View commit details
    Browse the repository at this point in the history

  4. update tests

    @zphang
    zphang committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    a3dfcc0 View commit details
    Browse the repository at this point in the history

  5. undo typo

    @zphang
    zphang committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    58fe9a6 View commit details
    Browse the repository at this point in the history

  6. fix vocab caching logic

    @zphang
    zphang committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    8eefcac View commit details
    Browse the repository at this point in the history

  7. ruff

    @zphang
    zphang committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    48c89c2 View commit details
    Browse the repository at this point in the history

  8. docbuilder

    @zphang
    zphang committed Mar 13, 2023
    Configuration menu
    Copy the full SHA
    c3dc391 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2023

  1. attn fix from BlackSamorez

    @zphang
    zphang committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    ef61b1b View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2023

  1. initial feedback

    @zphang
    zphang committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    49cc1eb View commit details
    Browse the repository at this point in the history

  2. typo

    @zphang
    zphang committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    8dbd0d1 View commit details
    Browse the repository at this point in the history

  3. docs

    @zphang
    zphang committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    28e103e View commit details
    Browse the repository at this point in the history

  4. llama case

    @zphang
    zphang committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    4297855 View commit details
    Browse the repository at this point in the history

  5. llama case

    @zphang
    zphang committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    612b694 View commit details
    Browse the repository at this point in the history

  6. load checkpoint docs

    @zphang
    zphang committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    de1cd5d View commit details
    Browse the repository at this point in the history

  7. comment about tokenizer

    @zphang
    zphang committed Mar 15, 2023
    Configuration menu
    Copy the full SHA
    951023f View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2023

  1. tokenizer defaults

    @zphang
    zphang committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    dcd5524 View commit details
    Browse the repository at this point in the history

  2. clear past_key_values if use_cache=False

    @zphang
    zphang committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    1f6f97d View commit details
    Browse the repository at this point in the history

  3. last tweaks

    @zphang
    zphang committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    7452ebd View commit details
    Browse the repository at this point in the history

  4. last tweaks

    @zphang
    zphang committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    6fce445 View commit details
    Browse the repository at this point in the history

  5. last tweaks

    @zphang
    zphang committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    66c8c80 View commit details
    Browse the repository at this point in the history

  6. last tweaks

    @zphang
    zphang committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    3884da1 View commit details
    Browse the repository at this point in the history