Repository navigation

Document intentional zero-init of RMSNorm scale - #481

Open

meemoprasad wants to merge 4 commits into

google-research:masterfrom

meemoprasad:fix/rmsnorm-zero-init

Open

Document intentional zero-init of RMSNorm scale#481
meemoprasad wants to merge 4 commits into
google-research:masterfrom
meemoprasad:fix/rmsnorm-zero-init

Commits on Sep 2, 2026
- Fix RMSNorm scale zero-initialization
  meemoprasad
  committed
  b6f1be2
Commits on Oct 21, 2026
- Initialize scale parameter to zeros
  meemoprasad
  authored
  93fb1a7
- Document intentional zero-init of RMSNorm scale (flax)
  meemoprasad
  authored
  ea196c8
- Document intentional zero-init of RMSNorm scale (torch)
  meemoprasad
  authored
  81a1b77