Description: Practical guidance for training MoE VLMs in Megatron Bridge. Compares FSDP and 3D-parallel approaches, using rounded lessons from Qwen3-VL, Qwen3-Next, and other multimodal experiments.
Lines: 137 | Code: 8 | Dir: nemo-mbridge-perf-moe-vlm-training
name: nemo-mbridge-perf-moe-vlm-training description: Practical guidance for training MoE VLMs in Megatron Bridge. Compares FSDP and 3D-parallel approaches, using rounded lessons from Qwen3-VL, Qw…