Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning
An automatic parallelization system for distributed deep learning that unifies intra-operator and inter-operator parallelism in a hierarchical space, using dynamic programming for …
