Description: Validate and use CPU offloading in Megatron Bridge, including layer-level activation offloading and fractional optimizer state offloading with HybridDeviceOptimizer.
Lines: 232 | Code: 63 | Dir: nemo-mbridge-perf-cpu-offloading
name: nemo-mbridge-perf-cpu-offloading description: Validate and use CPU offloading in Megatron Bridge, including layer-level activation offloading and fractional optimizer state offloading with H…