Description: Operational guide for enabling hierarchical context parallelism in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification.
Lines: 146 | Code: 44 | Dir: nemo-mbridge-perf-hierarchical-context-parallel
name: nemo-mbridge-perf-hierarchical-context-parallel description: Operational guide for enabling hierarchical context parallelism in Megatron-Bridge, including config knobs, code anchors, pitfall…