option
Home
Flash News
Content
SamuelClark
SamuelClark
July 23, 2026

Xiaohongshu's Dots Infra team open-sourced BigMac, a pipeline parallel training paradigm for multi-modal LLMs. It nests encoder/generator computation into an optimized LLM schedule, breaking the trade-off between compute speed and memory usage. On understanding tasks, BigMac achieves 1.08-1.9x speedup over baselines with stable memory; on generation tasks, it avoids OOM while delivering 1.5-1.9x speedup.

Xiaohongshu's Dots Infra team open-sourced BigMac, a pipeline parallel training paradigm for multi-modal LLMs. It nests encoder/generator computation into an optimized LLM schedule, breaking the trade-off between compute speed and memory usage. On understanding tasks, BigMac achieves 1.08-1.9x speedup over baselines with stable memory; on generation tasks, it avoids OOM while delivering 1.5-1.9x speedup. Xiaohongshu's Dots Infra team open-sourced BigMac, a pipeline parallel training paradigm for multi-modal LLMs. It nests encoder/generator computation into an optimized LLM schedule, breaking the trade-off between compute speed and memory usage. On understanding tasks, BigMac achieves 1.08-1.9x speedup over baselines with stable memory; on generation tasks, it avoids OOM while delivering 1.5-1.9x speedup.
Comments (0)
0/300
OR