Skip to content

Perform gradient clipping on global batch when using gradient accumulation#9

Open
ashors1 wants to merge 6 commits into
google:mainfrom
ashors1:ga_grad_clip
Open

Perform gradient clipping on global batch when using gradient accumulation#9
ashors1 wants to merge 6 commits into
google:mainfrom
ashors1:ga_grad_clip

address PR comments

2303ad8
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs