github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-16 06:30:41 +00:00
Code Issues Packages Projects Releases Wiki Activity

[cluster] add process group mesh (#4039)

Browse Source 
* [cluster] add process group mesh

* [test] add process group mesh test

* force sync
This commit is contained in:
Hongxin Liu
2023-06-20 10:39:06 +08:00
parent ff836790ae
commit 5e1a9d48dd
3 changed files with 356 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
colossalai/cluster/__init__.py
View File

@@ -1,5 +1,6 @@
from .device_mesh_manager import DeviceMeshManager
from .dist_coordinator import DistCoordinator
from .process_group_manager import ProcessGroupManager
from .process_group_mesh import ProcessGroupMesh
__all__ = ['DistCoordinator', 'ProcessGroupManager', 'DeviceMeshManager']
__all__ = ['DistCoordinator', 'ProcessGroupManager', 'DeviceMeshManager', 'ProcessGroupMesh']