github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-06-25 15:01:43 +00:00
Code Issues Packages Projects Releases Wiki Activity

[NFC] polish colossalai/engine/gradient_handler/utils.py code style (#2708)

Browse Source
This commit is contained in:
CZYCW 2023-02-15 09:40:08 +08:00 committed by GitHub
parent 6427c406cf
commit 4ac8bfb072
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 30 additions and 29 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
colossalai/engine/gradient_handler/utils.py
View File

@ -1,7 +1,8 @@
from typing import Iterable
import torch.distributed as dist import torch.distributed as dist
import torch.nn as nn import torch.nn as nn
from torch._utils import _flatten_dense_tensors, _unflatten_dense_tensors from torch._utils import _flatten_dense_tensors, _unflatten_dense_tensors
from typing import Iterable
def bucket_allreduce(param_list: Iterable[nn.Parameter], group=None): def bucket_allreduce(param_list: Iterable[nn.Parameter], group=None):