Frank Lee efef43b53c Merge pull request #5372 from hpcaitech/exp/mixtral

2024-02-08 16:30:05 +08:00

..

__init__.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

checkpoint_io_base.py

[moe] support mixtral (#5309)

2024-02-07 19:21:02 +08:00

general_checkpoint_io.py

[shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758)

2023-09-20 18:29:37 +08:00

hybrid_parallel_checkpoint_io.py

[llama] polish training script and fix optim ckpt (#5368)

2024-02-06 11:52:17 +08:00

index_file.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

utils.py

[shardformer] Fix serialization error with Tensor Parallel state saving (#5018)

2023-11-09 17:00:25 +08:00