Files
ColossalAI/colossalai/fx/passes/adding_split_node_pass.py
Ziyue Jiang 59e343328d [Pipeline Middleware ] Fix deadlock when num_microbatch=num_stage (#2156)
* add splitter

* polish code

* remove comment

* fix async nan by moving to cpu first

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2022-12-23 11:38:43 +08:00

6.1 KiB