TX_815300· Engineering
Reordered MoE checkpoint cuts SSD reads 2.23× and speeds decode 32% on 235B model
Reordering expert weights in a Mixture‑of‑Experts checkpoint halved SSD reads on an 80B model and delivered a 32.3% decode speedup on a 235B model, with three independent engine authors confirming the gains.