Skip to content

[rollout] In-memory relayout between sharded layouts (two-stage relay, pipelined execution) and ZeRO-3 training-state move - #9074

Draft
LiRunGuo wants to merge 5 commits into
deepspeedai:masterfrom
LiRunGuo:in-memory-relayout
Draft

LiRunGuo wants to merge 5 commits into
deepspeedai:masterfrom
LiRunGuo:in-memory-relayout

Commits

  1. Commits on Nov 12, 2026

  2. Commits on Nov 14, 2026

  3. Commits on Nov 15, 2026