mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-08-18 07:57:46 +00:00
1a809eddaa
* [feat][chatgpt]train prompts on ray example * [fix]simplify code * [fix]remove depreciated parameter * [fix]add dependencies * [fix]method calling * [fix]experience maker * [fix]missing loss function * [fix]init optimizer * [feat]add usage comment * [fix]rename files * [fix]add readme * [fix]file path * [fix]move directory --------- Co-authored-by: jiangwen <zxl265370@antgroup.com>
18 lines
803 B
Markdown
18 lines
803 B
Markdown
# ColossalAI on Ray
|
|
## Abstract
|
|
This is an experimental effort to run ColossalAI Chat training on Ray
|
|
## How to use?
|
|
### 1. Setup Ray clusters
|
|
Please follow the official [Ray cluster setup instructions](https://docs.ray.io/en/latest/cluster/getting-started.html) to setup an cluster with GPU support. Record the cluster's api server endpoint, it should be something similar to http://your.head.node.addrees:8265
|
|
### 2. Clone repo
|
|
Clone this project:
|
|
```shell
|
|
git clone https://github.com/hpcaitech/ColossalAI.git
|
|
```
|
|
### 3. Submit the ray job
|
|
```shell
|
|
python applications/Chat/examples/community/ray/ray_job_script.py http://your.head.node.addrees:8265
|
|
```
|
|
### 4. View your job on the Ray Dashboard
|
|
Open your ray cluster dashboard http://your.head.node.addrees:8265 to view your submitted training job.
|