DIP: Efficient Large Multimodal Model Training with Dynamic Interleaved Pipeline
A dynamic interleaved pipeline system for LMM training that separates modality segments to remove intra-segment imbalance, splits data into modality-aware sub-microbatches to …
