ver217 ae71036cd2 [utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548) ...

* refactor parallel layer

* broadcast rank0 model after load ckpt

2022-09-06 20:18:35 +08:00

..

__init__.py

[hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622)

2022-04-02 16:12:04 +08:00

_operation.py

[TP] change the check assert in split batch 2d (#772)

2022-04-16 21:29:57 +08:00

_utils.py

moved env variables to global variables; (#215)

2022-02-15 11:31:13 +08:00

layers.py

[utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548)

2022-09-06 20:18:35 +08:00