Description: MoE expert-parallel communication overlap in Megatron Bridge. Covers dispatch/combine overlap, flex dispatcher backends, and expert wgrad scheduling.
Lines: 189 | Code: 23 | Dir: nemo-mbridge-perf-moe-comm-overlap
name: nemo-mbridge-perf-moe-comm-overlap description: MoE expert-parallel communication overlap in Megatron Bridge. Covers dispatch/combine overlap, flex dispatcher backends, and expert wgrad sche…