Skip to content

fix: fix grad accumulation/overlap under ZeRO-2 - #213

Open
Chamberlain0w0 wants to merge 3 commits into
masterfrom
fix/fix_zero2_grad_accu
Open

fix: fix grad accumulation/overlap under ZeRO-2#213
Chamberlain0w0 wants to merge 3 commits into
masterfrom
fix/fix_zero2_grad_accu

fix: fix bucket group sync behaviors

b55969a
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar