Fix DeepCompile ZeRO-1 grad target lifetime#8036

tohtana wants to merge 3 commits into

deepspeedai:masterdeepspeedai/DeepSpeed:masterfrom

tohtana:tohtana/fix/deepcompile-zero1-flat-releasetohtana/DeepSpeed:tohtana/fix/deepcompile-zero1-flat-releaseCopy head branch name to clipboard