github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-02 01:28:31 +00:00
Code Issues Packages Projects Releases Wiki Activity

[example] Modify palm example with the new booster API (#3913)

Browse Source 
* Modify torch version requirement to adapt torch 2.0

* modify palm example using new booster API

* roll back

* fix port

* polish

* polish
This commit is contained in:
Liu Ziming
2023-06-07 16:05:00 +08:00
committed by GitHub
parent a55fb00c18
commit b306cecf28
4 changed files with 34 additions and 29 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/language/palm/README.md
View File

@@ -43,6 +43,9 @@ palm = PaLM(
)
```
## New API
We have modified our previous implementation of PaLM with our new Booster API, which offers a more flexible and efficient way to train your model. The new API is more user-friendly and easy to use. You can find the new API in train.py. We have also offer a shell script test_ci.sh for you to go through all our plugins for the booster. For more information about the booster API you can refer to https://colossalai.org/docs/basics/booster_api/.
## Test on Enwik8
```bash