Skip to content

Latest commit

 

History

History
611 lines (450 loc) · 54.2 KB

changelog.md

File metadata and controls

611 lines (450 loc) · 54.2 KB

Changelog of v0.x

v0.8.4 (03/08/2023)

New Features & Enhancements

Bug fixes

Docs

Contributors

A total of 3 developers contributed to this release. Thanks @HAOCHENYE, @zhouzaida, @LZHgrla

v0.8.3 (31/07/2023)

Highlights

  • Support enabling efficient_conv_bn_eval for efficient convolution and batch normalization. See save memory on gpu for more details
  • Add Llama2 finetune example
  • Support multi-node distributed training with MLU backend

New Features & Enhancements

Bug fixes

Docs

Contributors

A total of 9 developers contributed to this release. Thanks @HAOCHENYE, @youkaichao, @josh6688, @i-aki-y, @mmeendez8, @zhouzaida, @gachiemchiep, @KerwinKai, @Li-Qingyun

v0.8.2 (07/12/2023)

Bug fixes

v0.8.1 (07/05/2023)

New Features & Enhancements

Bug fixes

Docs

v0.8.0 (06/30/2023)

Highlights

  • Support training with FSDP and DeepSpeed. Refer to the example for more detailed usages.

  • Introduce the pure Python style configuration file:

    • Support navigating to base configuration file in IDE
    • Support navigating to base variable in IDE
    • Support navigating to source code of class in IDE
    • Support inheriting two configuration files containing the same field
    • Load the configuration file without other third-party requirements

    Refer to the tutorial for more detailed usages.

    new-config-en

New Features & Enhancements

Bug fixes

Docs

Contributors

A total of 9 developers contributed to this release. Thanks @evdcush, @zhouzaida, @AkideLiu, @joihn, @HAOCHENYE, @edkair, @alexander-soare, @syo093c, @zgzhengSEU

v0.7.4 (06/03/2023)

Highlights

  • Support using ClearML to record experiment data
  • Add Sophia optimizers

New Features & Enhancements

Bug fixes

Docs

Contributors

A total of 19 developers contributed to this release. Thanks @Hongru-Xiao @i-aki-y @Bomsw @KickCellarDoor @zhouzaida @YQisme @gachiemchiep @CescMessi @W-ZN @Ginray @adrianjoshua-strutt @CokeDong @xin-li-67 @Xiangxu-0103 @HAOCHENYE @Shiyang980713 @TankNee @zimonitrome @gy-7

v0.7.3 (04/28/2023)

Highlights

  • Support using MLflow to record experiment data
  • Support registering callable objects to the registry

New Features & Enhancements

Bug fixes

Docs

Contributors

A total of 17 developers contributed to this release. Thanks @enkilee, @JunweiZheng93, @sh0622-kim, @jsrdcht, @SheffieldCao, @josh6688, @mzr1996, @zhouzaida, @shufanwu, @Luo-Yihang, @C1rN09, @LEFTeyex, @zccjjj, @Ginray, @HAOCHENYE, @sjiang95, @luomaoling

v0.7.2 (04/06/2023)

Bug fixes

Contributors

A total of 3 developers contributed to this release. Thanks @kitecats, @BIGWangYuDong, @HAOCHENYE

v0.7.1 (04/03/2023)

Highlights

  • Support compiling the model and enabling mixed-precision training at the same time
  • Fix the bug where the logs cannot be properly saved to the log file after calling torch.compile

New Features & Enhancements

Bug fixes

Docs

Contributors

A total of 7 developers contributed to this release. Thanks @LEFTeyex, @KerwinKai, @mzr1996, @evdcush, @C1rN09, @HAOCHENYE, @zhouzaida

v0.7.0 (03/16/2023)

Highlights

  • Support PyTorch 2.0! Accelerate training by compiling models. See the tutorial Model Compilation for details
  • Add EarlyStoppingHook to stop training when the metric does not improve

New Features & Enhancements

Bug fixes

Docs

Contributors

A total of 10 developers contributed to this release. Thanks @xin-li-67, @acdart, @enkilee, @YuetianW, @luomaoling, @nijkah, @VoyagerXvoyagerx, @zhouzaida, @HAOCHENYE, @C1rN09

v0.6.0 (02/24/2023)

Highlights

  • Support Apex with ApexOptimWrapper
  • Support analyzing model complexity.
  • Add Lion optimizer.
  • Support using environment variables in the config file.

New Features & Enhancements

Bug fixes

Docs

Contributors

A total of 15 developers contributed to this release. Thanks @Eiuyc, @xcnick, @KevinNuNu, @XWHtorrentx, @tonysy, @zhouzaida, @Xiangxu-0103, @Dai-Wenxun, @jbwang1997, @apacha, @C1rN09, @HIT-cwh, @vansin, @HAOCHENYE, @luomaoling.

v0.5.0 (01/20/2023)

Highlights

  • Add BaseInferencer to provide a general inference interface
  • Provide ReduceOnPlateauParamScheduler to adjust learning rate by metric
  • Deprecate support for Python3.6

New Features & Enhancements

Bug Fixes

Docs

Contributors

A total of 8 developers contributed to this release. Thanks @LEFTeyex, @RangeKing, @yaqi0510, @Xiangxu-0103, @wangjiangben-hw, @mzr1996, @zhouzaida, @HAOCHENYE.

v0.4.0 (12/28/2022)

Highlights

  • Registry supports importing modules automatically
  • Upgrade the documentation and provide the English documentation
  • Provide ProfileHook to profile the running process

New Features & Enhancements

Bug Fixes

Docs

Contributors

A total of 16 developers contributed to this release. Thanks @BayMaxBHL, @RangeKing, @Xiangxu-0103, @xin-li-67, @twmht, @shanmo, @sunyc11, @lyviva, @austinmw, @xiexinch, @mzr1996, @RangiLyu, @MambaWong, @C1rN09, @zhouzaida, @HAOCHENYE

v0.3.2 (11/24/2022)

New Features & Enhancements

Bug Fixes

Docs

v0.3.1 (11/09/2022)

Highlights

  • Fix error when saving best checkpoint in ddp-training

New Features & Enhancements

Bug Fixes

Docs

v0.3.0 (11/02/2022)

New Features & Enhancements

Docs

Bug Fixes

New Contributors

v0.2.0 (10/11/2022)

New Features & Enhancements

Docs

Bug Fixes

New Contributors