Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AMP] support GPU BF16 amp for dygraph #39029

Merged
merged 22 commits into from
Feb 18, 2022
Merged

[AMP] support GPU BF16 amp for dygraph #39029

merged 22 commits into from
Feb 18, 2022

Commits on Jan 18, 2022

  1. support dtype param for auto_cast

    @zhangbo9674
    zhangbo9674 committed Jan 18, 2022
    Configuration menu
    Copy the full SHA
    579a85b View commit details
    Browse the repository at this point in the history

  2. add amp_dtype for tracer

    @zhangbo9674
    zhangbo9674 committed Jan 18, 2022
    Configuration menu
    Copy the full SHA
    2f5f316 View commit details
    Browse the repository at this point in the history

  3. add unsupported bf16 list

    @zhangbo9674
    zhangbo9674 committed Jan 18, 2022
    Configuration menu
    Copy the full SHA
    a2034da View commit details
    Browse the repository at this point in the history

  4. support bf16 amp for O2

    @zhangbo9674
    zhangbo9674 committed Jan 18, 2022
    Configuration menu
    Copy the full SHA
    12e327f View commit details
    Browse the repository at this point in the history

  5. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … dev/bf16_a100
    @zhangbo9674
    zhangbo9674 committed Jan 18, 2022
    Configuration menu
    Copy the full SHA
    ab98946 View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2022

  1. refine python interface for bfloat16

    @zhangbo9674
    zhangbo9674 committed Jan 19, 2022
    Configuration menu
    Copy the full SHA
    2a0bd30 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … dev/bf16_a100
    @zhangbo9674
    zhangbo9674 committed Jan 19, 2022
    Configuration menu
    Copy the full SHA
    369e369 View commit details
    Browse the repository at this point in the history

Commits on Jan 21, 2022

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … dev/bf16_a100
    @zhangbo9674
    zhangbo9674 committed Jan 21, 2022
    Configuration menu
    Copy the full SHA
    2b28531 View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2022

  1. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … dev/bf16_a100
    @zhangbo9674
    zhangbo9674 committed Jan 24, 2022
    Configuration menu
    Copy the full SHA
    4f2bd71 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2022

  1. merge develop

    @zhangbo9674
    zhangbo9674 committed Feb 7, 2022
    Configuration menu
    Copy the full SHA
    a86a7b3 View commit details
    Browse the repository at this point in the history

  2. refine code

    @zhangbo9674
    zhangbo9674 committed Feb 7, 2022
    Configuration menu
    Copy the full SHA
    ed03311 View commit details
    Browse the repository at this point in the history

  3. refine code

    @zhangbo9674
    zhangbo9674 committed Feb 7, 2022
    Configuration menu
    Copy the full SHA
    137e998 View commit details
    Browse the repository at this point in the history

  4. refine unittest

    @zhangbo9674
    zhangbo9674 committed Feb 7, 2022
    Configuration menu
    Copy the full SHA
    7fa4fa4 View commit details
    Browse the repository at this point in the history

Commits on Feb 10, 2022

  1. solve conflict

    @zhangbo9674
    zhangbo9674 committed Feb 10, 2022
    Configuration menu
    Copy the full SHA
    9d348a4 View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2022

  1. refine code

    @zhangbo9674
    zhangbo9674 committed Feb 14, 2022
    Configuration menu
    Copy the full SHA
    82b8ac1 View commit details
    Browse the repository at this point in the history

  2. refine code

    @zhangbo9674
    zhangbo9674 committed Feb 14, 2022
    Configuration menu
    Copy the full SHA
    0d6d699 View commit details
    Browse the repository at this point in the history

  3. add bf16 o1

    @zhangbo9674
    zhangbo9674 committed Feb 14, 2022
    Configuration menu
    Copy the full SHA
    63e5377 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2022

  1. refine code by comment

    @zhangbo9674
    zhangbo9674 committed Feb 15, 2022
    Configuration menu
    Copy the full SHA
    570e494 View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2022

  1. solve conflict & merge develop

    @zhangbo9674
    zhangbo9674 committed Feb 16, 2022
    Configuration menu
    Copy the full SHA
    1fd45f7 View commit details
    Browse the repository at this point in the history

Commits on Feb 17, 2022

  1. add gradient accumulator

    @zhangbo9674
    zhangbo9674 committed Feb 17, 2022
    Configuration menu
    Copy the full SHA
    22097fe View commit details
    Browse the repository at this point in the history

  2. add recompute

    @zhangbo9674
    zhangbo9674 committed Feb 17, 2022
    Configuration menu
    Copy the full SHA
    bc056f8 View commit details
    Browse the repository at this point in the history

  3. solve conflict

    @zhangbo9674
    zhangbo9674 committed Feb 17, 2022
    Configuration menu
    Copy the full SHA
    f1912be View commit details
    Browse the repository at this point in the history