Cornstarch: Efficient Distributed MLLM Training with Frozen-Aware Parallelism and Balanced Context Parallelism
A distributed MLLM training system that makes pipeline parallelism frozen-status aware to eliminate bubbles, introduces token workload-balanced context parallelism for the mixed …
