github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-02 01:28:31 +00:00
Code Issues Packages Projects Releases Wiki Activity

[builder] raise Error when CUDA_HOME is not set (#2213)

Browse Source
This commit is contained in:
Jiarui Fang
2022-12-28 16:07:08 +08:00
committed by GitHub
parent 78a89d9b41
commit 7675792100
7 changed files with 19 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
examples/language/gpt/README.md
View File

@@ -106,3 +106,8 @@ Touch the bar of model scale and batch size.
| gpt2_20b | 8 | auto | 2 | 16 | 99.871 |
| gpt2_20b | 8 | cpu | 2 | 64 | 125.170 |
| gpt2_20b | 8 | const | 2 | 32 | 105.415 |
| model | #GPU | policy | TP | batch per DP | Tflops |
| ---------- | --------- |--------- |--------- |--------- |--------- |
| gpt2_20b | 8 | cpu | 2 | 8 | 46.895 |