Skip to content

Commit

Permalink
remove assert
Browse files Browse the repository at this point in the history
Signed-off-by: Alexandros Koumparoulis <akoumparouli@nvidia.com>
  • Loading branch information
akoumpa committed Sep 23, 2024
1 parent 3f88d73 commit a9ff192
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions nemo/collections/llm/gpt/model/base.py
Original file line number Diff line number Diff line change
Expand Up @@ -262,8 +262,6 @@ def configure_model(self) -> None:
'use_te_rng_tracker', False
), "Transformer engine's RNG tracker is required for cudagraphs, it can be "\
"enabled with use_te_rng_tracker=True'."
assert not self.config.gradient_accumulation_fusion, \
"gradient_accumulation_fusion is not supported with enable_cuda_graph"

self.module = self.config.configure_model(self.tokenizer)

Expand Down

0 comments on commit a9ff192

Please sign in to comment.