github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-04-28 11:45:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
7f8b16635b
ColossalAI/docs/source/en/features/cluster_utils.md
Hongxin Liu 72688adb2f
[doc] add booster docstring and fix autodoc (#3789) 
* [doc] add docstr for booster methods

* [doc] fix autodoc
2023-05-22 10:56:47 +08:00

497 B
Raw Blame History

Cluster Utilities

Author: Hongxin Liu

Prerequisite:

Introduction

We provide a utility class colossalai.cluster.DistCoordinator to coordinate distributed training. It's useful to get various information about the cluster, such as the number of nodes, the number of processes per node, etc.

API Reference

{{ autodoc:colossalai.cluster.DistCoordinator }}