LuGY a78daf6180 [shardformer] support interleaved pipeline (#4448) ...

* support interleaved pipeline

* fix unit test

* remove virtual stage test in stage mgr

* add droped type hint and updated bwd

2023-08-16 19:29:03 +08:00

..

middleware

[Pipeline Middleware] Adapt scheduler for Topo (#2066)

2022-12-05 20:23:41 +08:00

rpc

[nfc]fix typo colossalai/pipeline tensor nn (#3899)

2023-06-06 14:07:36 +08:00

schedule

[shardformer] support interleaved pipeline (#4448)

2023-08-16 19:29:03 +08:00

__init__.py

fix file name (#1759)

2022-10-25 16:48:48 +08:00

layer_spec.py

fix file name (#1759)

2022-10-25 16:48:48 +08:00

p2p.py

[shardformer] support interleaved pipeline (#4448)

2023-08-16 19:29:03 +08:00

pipelinable.py

[nfc]fix typo colossalai/pipeline tensor nn (#3899)

2023-06-06 14:07:36 +08:00

pipeline_process_group.py

[pipeline/fix-bug] num_microbatches support any integrate | stable chimera | launch tool for rpc pp framework (#1684)

2022-10-10 16:01:02 +08:00

stage_manager.py

[shardformer] support interleaved pipeline (#4448)

2023-08-16 19:29:03 +08:00

utils.py

[nfc]fix typo colossalai/pipeline tensor nn (#3899)

2023-06-06 14:07:36 +08:00