Skip to content

Perform gradient clipping on global batch when using gradient accumulation#6

Open
ashors1 wants to merge 9 commits into
google:mainfrom
ashors1:ga_grad_clip
Open

Perform gradient clipping on global batch when using gradient accumulation#6
ashors1 wants to merge 9 commits into
google:mainfrom
ashors1:ga_grad_clip

address PR comments

40a6d80
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs