LuGY a78daf6180 [shardformer] support interleaved pipeline (#4448) ...

* support interleaved pipeline

* fix unit test

* remove virtual stage test in stage mgr

* add droped type hint and updated bwd

2023-08-16 19:29:03 +08:00

..

__init__.py

[cluster] add process group mesh (#4039)

2023-08-15 23:25:14 +08:00

device_mesh_manager.py

[API] implement device mesh manager (#3221)

2023-03-24 13:39:12 +08:00

dist_coordinator.py

fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808)

2023-05-24 09:01:50 +08:00

process_group_manager.py

[booster] implemented the cluster module (#3191)

2023-03-22 14:11:54 +08:00

process_group_mesh.py

[shardformer] support interleaved pipeline (#4448)

2023-08-16 19:29:03 +08:00