6 Commits

Author SHA1 Message Date
Tong Li
68ec99e946 [hotfix] add soft link to support required files (#5661) 2024-04-26 21:12:04 +08:00
Hongxin Liu
1b387ca9fe [shardformer] refactor pipeline grad ckpt config (#5646)
* [shardformer] refactor pipeline grad ckpt config

* [shardformer] refactor pipeline grad ckpt config

* [pipeline] fix stage manager
2024-04-25 15:19:30 +08:00
binmakeswell
f4c5aafe29 [example] llama3 (#5631)
* release llama3

* [release] llama3

* [release] llama3

* [release] llama3

* [release] llama3
2024-04-23 18:48:07 +08:00
Hongxin Liu
0b00def881 [example] add llama2 example (#4527)
* [example] transfer llama-1 example

* [example] fit llama-2

* [example] refactor scripts folder

* [example] fit new gemini plugin

* [cli] fix multinode runner

* [example] fit gemini optim checkpoint

* [example] refactor scripts

* [example] update requirements

* [example] update requirements

* [example] rename llama to llama2

* [example] update readme and pretrain script

* [example] refactor scripts
2023-08-28 17:59:11 +08:00
binmakeswell
ef4b99ebcd add llama example CI 2023-07-26 14:12:57 +08:00
binmakeswell
7ff11b5537 [example] add llama pretraining (#4257) 2023-07-17 21:07:44 +08:00