github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-10 13:30:19 +00:00
Code Issues Packages Projects Releases Wiki Activity

[gemini] update the gpt example (#2527)

Browse Source
This commit is contained in:
HELSON
2023-01-30 17:58:05 +08:00
committed by GitHub
parent ecbad93b65
commit 66dfcf5281
4 changed files with 75 additions and 98 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/language/gpt/gemini/benchmark_gemini.sh
View File

@@ -1,5 +1,5 @@
for MODEL_TYPE in "gpt2_medium"; do
for DISTPLAN in "colossalai"; do
for DISTPLAN in "CAI_Gemini"; do
for BATCH_SIZE in 16; do
for GPUNUM in 1 2 4 8; do
for TPDEGREE in 1 2 4 8; do