github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-08 04:24:47 +00:00
Code Issues Packages Projects Releases Wiki Activity

[gemini] add GeminiMemoryManger (#832)

Browse Source 
* refactor StatefulTensor, tensor utilities

* add unitest for GeminiMemoryManager
This commit is contained in:
HELSON
2022-04-24 13:08:48 +08:00
committed by GitHub
parent 35ea6e1023
commit e5ea3fdeef
23 changed files with 414 additions and 180 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/zero/__init__.py
View File

@@ -35,4 +35,4 @@ def convert_to_zero_v2(model: nn.Module, optimizer: torch.optim.Optimizer, model
return zero_model, zero_optimizer
__all__ = ['convert_to_zerov2', 'ShardedModelV2', 'ShardedOptimizerV2']
__all__ = ['convert_to_zero_v2', 'ShardedModelV2', 'ShardedOptimizerV2']