flybird11111 0688d92e2d [shardformer]Fix lm parallel. (#5480) ...

* fix

* padding vocab_size when using pipeline parallellism

padding vocab_size when using pipeline parallellism

fix

fix

* fix

* fix

fix

fix

* fix gather output

* fix

* fix

* fix

fix resize embedding

fix resize embedding

* fix resize embedding

fix

* revert

* revert

* revert

* fix lm forward distribution

* fix

* test ci

* fix

2024-03-25 17:21:51 +08:00

..

test_adam_kernel.py

[feat] refactored extension module (#5298)

2024-01-25 17:01:48 +08:00

test_adam_optim.py

[kernel] support pure fp16 for cpu adam and update gemini optim tests (#4921)

2023-10-16 21:56:53 +08:00

test_lr_scheduler.py

[lr-scheduler] fix load state dict and add test (#5369)

2024-02-06 14:23:32 +08:00

test_nvme.py

[shardformer]Fix lm parallel. (#5480)

2024-03-25 17:21:51 +08:00