SparseLoCo: Communication Efficient LLM Pre-training with Sparsity-driven Data Synchronization

Mar 18, 2026·
Jiaqi Li
Jiaqi Li
· 0 min read
The SparseLoCo workflow
Abstract
Review of paper writing approach, summarizing research themes and innovations, sharing paper submission experiences.
Date
Mar 18, 2026 8:30 AM — 9:15 AM
Event
SparseLoCo: Communication Efficient LLM Pre-training with Sparsity-driven Data Synchronization
Location

Room 101, Xinda Building B

events
Group Meeting Research Sharing Distributed Training Communication Compression
Sina Weibo
Jiaqi Li
Authors
Jiaqi Li (he/him)
M.S. Student
Received B.E. in Computer Science and Technology from CUIT in June 2023. Currently pursuing Master’s degree in Artificial Intelligence at CUIT since 2024.