openamer

nemo-mbridge-perf-sequence-packing

Description: Validate and use packed sequences and long-context training in Megatron-Bridge, including offline LLM packing, collate-time VLM packing, Energon online packing, and CP constraints. Lines: 308 | Code: 122 | Dir: nemo-mbridge-perf-sequence-packing



name: nemo-mbridge-perf-sequence-packing description: Validate and use packed sequences and long-context training in Megatron-Bridge, including offline LLM packing, collate-time VLM packing, Energ…