Memory Optimization

QPO: Accelerating Memory-Efficient DNN Training with Quantization and Pipelining featured image

QPO: Accelerating Memory-Efficient DNN Training with Quantization and Pipelining

A memory-efficient DNN training framework that combines quantization with pipelined offloading and prefetching, overlapping gradient/activation transfers with computation to reduce …

avatar
Jiaqi Li
•