mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2026-07-16 17:16:14 +00:00
* adjust to dynamic prompt bs * remove debug * update pad seq (#6303) Co-authored-by: Tong Li <tong.li35271158@gmail.com> * adjust to dynamic prompt bs * remove debug * fix dp issue * fix * fix default settings --------- Co-authored-by: Tong Li <tong.li35271158@gmail.com>
Requirements
pip install cupy-cuda12x
python -m cupyx.tools.install_library --cuda 12.x --library nccl