LLM Compression & Efficient Inference
Quantization, sparsification, and efficient inference techniques for large language models on domestic accelerators.
•
1 min read
Quantization, sparsification, and efficient inference techniques for large language models on domestic accelerators.