github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-05-07 16:08:22 +00:00
Code Issues Packages Projects Releases Wiki Activity
38ccb8b1a3
ColossalAI/colossalai/checkpoint_io
History
Baizhou Zhang 38ccb8b1a3
[shardformer] support from_pretrained when loading model with HybridParallelPlugin () 
* hybrid plugin support huggingface from_pretrained

* add huggingface compatibility tests

* add folder cleaning

* fix bugs
2023-09-01 17:40:01 +08:00
..
__init__.py [shardformer] support sharded checkpoint IO for models of HybridParallelPlugin () 2023-08-25 22:04:57 +08:00
checkpoint_io_base.py Next commit [checkpointio] Unsharded Optimizer Checkpoint for Gemini Plugin () 2023-07-07 16:33:06 +08:00
general_checkpoint_io.py [checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin () 2023-07-21 14:39:01 +08:00
hybrid_parallel_checkpoint_io.py [shardformer] support from_pretrained when loading model with HybridParallelPlugin () 2023-09-01 17:40:01 +08:00
index_file.py [checkpointio] General Checkpointing of Sharded Optimizers () 2023-06-15 15:21:26 +08:00
utils.py [shardformer] support from_pretrained when loading model with HybridParallelPlugin () 2023-09-01 17:40:01 +08:00