github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-10-31 13:59:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
0b76b57cd64be15f2ae7e5ebd8dd4d327c4685c3
ColossalAI/docs/source/en/features/cluster_utils.md
Hongxin Liu 72688adb2f [doc] add booster docstring and fix autodoc (#3789) 
* [doc] add docstr for booster methods

* [doc] fix autodoc
2023-05-22 10:56:47 +08:00

497 B
Raw Blame History

Cluster Utilities

Author: Hongxin Liu

Prerequisite:

Introduction

We provide a utility class colossalai.cluster.DistCoordinator to coordinate distributed training. It's useful to get various information about the cluster, such as the number of nodes, the number of processes per node, etc.

API Reference

{{ autodoc:colossalai.cluster.DistCoordinator }}