Description: Long-context MoE training guidance for Megatron Bridge. Covers CP sizing, selective recompute, dispatcher choices, and practical patterns from DSV3, Qwen3, and Qwen3-Next long-context experiments.
Lines: 140 | Code: 15 | Dir: nemo-mbridge-perf-moe-long-context
name: nemo-mbridge-perf-moe-long-context description: Long-context MoE training guidance for Megatron Bridge. Covers CP sizing, selective recompute, dispatcher choices, and practical patterns from…