Normalize ZeRO-3 DeepCompile grad dtype before reduction#8038

tohtana wants to merge 1 commit into

deepspeedai:masterdeepspeedai/DeepSpeed:masterfrom

tohtana:tohtana/fix/deepcompile-zero3-grad-dtype-bucketstohtana/DeepSpeed:tohtana/fix/deepcompile-zero3-grad-dtype-bucketsCopy head branch name to clipboard