mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-09-06 11:32:10 +00:00
[workflow] fixed oom tests (#5275)
* [workflow] fixed oom tests * polish * polish * polish
This commit is contained in:
@@ -63,6 +63,9 @@ config = transformers.GPTJConfig(
|
||||
n_layer=2,
|
||||
n_head=4,
|
||||
vocab_size=50258,
|
||||
n_embd=256,
|
||||
hidden_size=256,
|
||||
n_positions=512,
|
||||
attn_pdrop=0,
|
||||
embd_pdrop=0,
|
||||
resid_pdrop=0,
|
||||
|
Reference in New Issue
Block a user