github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-09 04:50:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

[checkpoint] add ColoOptimizer checkpointing (#1316)

Browse Source
This commit is contained in:
Jiarui Fang
2022-07-15 09:52:55 +08:00
committed by GitHub
parent 7c2634f4b3
commit 9e4c6449b0
3 changed files with 74 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
colossalai/nn/optimizer/colossalai_optimizer.py
View File

@@ -1,6 +1,3 @@
#!/usr/bin/env python
# -*- encoding: utf-8 -*-
import torch
import torch.nn as nn
from torch import Tensor