Xuanlei Zhao f71e63b0f3 [moe] support optimizer checkpoint (#5015) ...

* Refactor MoE Manager setup method

* unshard optim ckpt

* optim io

* update transformer version

* update requirements

* update ckpt

* update ckpt

* update ckpt

* fix engine

* fix engine

2023-11-08 15:07:03 +00:00

..

__init__.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00

_operation.py

…

checkpoint.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00

experts.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00

layers.py

…

load_balance.py

…

loss.py

…

manager.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00

routers.py

…

utils.py

…