Description: Operational guide for enabling TP, DP, and PP communication overlap in Megatron-Bridge, including config knobs, code anchors, pitfalls, and verification.
Lines: 120 | Code: 43 | Dir: nemo-mbridge-perf-tp-dp-comm-overlap
name: nemo-mbridge-perf-tp-dp-comm-overlap description: Operational guide for enabling TP, DP, and PP communication overlap in Megatron-Bridge, including config knobs, code anchors, pitfalls, and …