Baizhou Zhang ed4c448488 [pipeline] rewrite t5 tests & support multi-tensor transmitting in pipeline (#4388) ...

* fix remaining t5 bugs/rewrite t5 tests

* fix multi-tensor communication in pipeline

* rearrange test_config

* fix keyerror in sync_shared_params

* fix get_held_layers & Randomnizer, complete t5 tests

* erase printing

* fix get_held_layers through modifying _release_unheld_layers

* fix _get_recursive_held_layers bug

2023-08-15 23:25:14 +08:00

..

middleware

[Pipeline Middleware] Adapt scheduler for Topo (#2066)

2022-12-05 20:23:41 +08:00

rpc

[nfc]fix typo colossalai/pipeline tensor nn (#3899)

2023-06-06 14:07:36 +08:00

schedule

[pipeline] rewrite t5 tests & support multi-tensor transmitting in pipeline (#4388)

2023-08-15 23:25:14 +08:00

__init__.py

fix file name (#1759)

2022-10-25 16:48:48 +08:00

layer_spec.py

fix file name (#1759)

2022-10-25 16:48:48 +08:00

p2p.py

[pipeline] rewrite t5 tests & support multi-tensor transmitting in pipeline (#4388)

2023-08-15 23:25:14 +08:00

pipelinable.py

[nfc]fix typo colossalai/pipeline tensor nn (#3899)

2023-06-06 14:07:36 +08:00

pipeline_process_group.py

[pipeline/fix-bug] num_microbatches support any integrate | stable chimera | launch tool for rpc pp framework (#1684)

2022-10-10 16:01:02 +08:00

stage_manager.py

[pipeline] add stage manager (#4093)

2023-08-15 23:25:14 +08:00

utils.py

[nfc]fix typo colossalai/pipeline tensor nn (#3899)

2023-06-06 14:07:36 +08:00