Files
ColossalAI/applications/ColossalChat/coati/distributed

Requirements

pip install cupy-cuda12x
python -m cupyx.tools.install_library --cuda 12.x --library nccl