Ziyue Jiang
|
ad00894f7f
|
polish
|
2023-01-06 16:03:16 +08:00 |
|
Jiarui Fang
|
1aaeb596c6
|
[example] gpt, shard init on all processes (#2366)
|
2023-01-06 15:44:50 +08:00 |
|
Ziyue Jiang
|
3a15b20421
|
Move GPT PP Example
|
2023-01-06 14:48:58 +08:00 |
|
YuliangLiu0306
|
8b1e0dfd80
|
[example] upload auto parallel gpt2 demo (#2354)
|
2023-01-06 11:38:38 +08:00 |
|
Jiarui Fang
|
00a9c781fd
|
[example] add google doc for benchmark results of GPT (#2355)
|
2023-01-06 11:38:15 +08:00 |
|
Jiarui Fang
|
509a87f3ff
|
[example] make gpt example directory more clear (#2353)
|
2023-01-06 11:11:26 +08:00 |
|
Ikko Eltociear Ashimine
|
5e4bced0a3
|
[NFC] Update roberta/README.md (#2350)
|
2023-01-06 10:09:14 +08:00 |
|
Jiarui Fang
|
35e22be2f6
|
[example] simplify opt example (#2344)
|
2023-01-06 10:08:41 +08:00 |
|
ziyuhuang123
|
7080a8edb0
|
[workflow]New version: Create workflow files for examples' auto check (#2298)
* [workflows]bug_repair
* [workflow]new_pr_fixing_bugs
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
|
2023-01-06 09:26:49 +08:00 |
|
binmakeswell
|
d7352bef2c
|
[example] add example requirement (#2345)
|
2023-01-06 09:03:29 +08:00 |
|
ZijianYY
|
f7fd592bf4
|
[examples]adding tp to PaLM (#2319)
|
2023-01-05 17:57:50 +08:00 |
|
HELSON
|
e00cedd181
|
[example] update gemini benchmark bash (#2306)
|
2023-01-04 11:59:26 +08:00 |
|
ZijianYY
|
df1d6dc553
|
[examples] using args and combining two versions for PaLM (#2284)
|
2023-01-03 17:49:00 +08:00 |
|
Ziyue Jiang
|
ac863a01d6
|
[example] add benchmark (#2276)
* add benchmark
* merge common func
* add total and avg tflops
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
|
2023-01-03 17:20:59 +08:00 |
|
Jiarui Fang
|
879df8b943
|
[example] GPT polish readme (#2274)
|
2023-01-03 15:46:52 +08:00 |
|
Ziyue Jiang
|
9654df0e9a
|
Add GPT PP Example (#2272)
Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
|
2023-01-03 15:17:26 +08:00 |
|
YuliangLiu0306
|
4b29112ab2
|
[autoparallel] gpt2 autoparallel examples (#2267)
* [autoparallel] gpt2 autoparallel examples
* polish code
* polish code
|
2023-01-03 14:23:33 +08:00 |
|
HELSON
|
09c0102fe6
|
[example] fix gpt example with 0.1.10 (#2265)
|
2023-01-03 13:38:14 +08:00 |
|
Jiarui Fang
|
db4cbdc7fb
|
[builder] builder for scaled_upper_triang_masked_softmax (#2234)
|
2022-12-30 09:58:00 +08:00 |
|
HELSON
|
31fe84237b
|
[example] fix benchmark.sh for gpt example (#2229)
|
2022-12-29 23:00:14 +08:00 |
|
Jiarui Fang
|
2cdecc9f38
|
[example] make palm + GeminiDPP work (#2227)
|
2022-12-29 14:28:31 +08:00 |
|
ZijianYY
|
63cc77173b
|
[example] Palm adding gemini, still has bugs (#2221)
|
2022-12-29 14:01:09 +08:00 |
|
HELSON
|
7010e18134
|
[example] update gpt example (#2225)
|
2022-12-29 12:01:45 +08:00 |
|
Jiarui Fang
|
49c601da21
|
[example] add benchmark.sh for gpt (#2226)
|
2022-12-29 12:00:00 +08:00 |
|
HELSON
|
3629e611cd
|
[example] update gpt benchmark (#2219)
|
2022-12-29 10:51:42 +08:00 |
|
ZijianYY
|
92de90dfb3
|
[examples] replace einsum with matmul (#2210)
|
2022-12-28 19:03:06 +08:00 |
|
Jiarui Fang
|
7675792100
|
[builder] raise Error when CUDA_HOME is not set (#2213)
|
2022-12-28 16:07:08 +08:00 |
|
Jiarui Fang
|
d96cc37e32
|
[example] update GPT example benchmark results (#2212)
|
2022-12-28 14:28:12 +08:00 |
|
Jiarui Fang
|
d5e3e3ec01
|
[example] update gpt example for larger model scale (#2211)
|
2022-12-28 13:54:08 +08:00 |
|
Jiarui Fang
|
29868a9ec1
|
[example] update gpt readme with performance (#2206)
|
2022-12-27 17:39:53 +08:00 |
|
Jiarui Fang
|
65f56f49e8
|
[example] gpt demo more accuracy tflops (#2178)
|
2022-12-22 20:51:35 +08:00 |
|
Jiarui Fang
|
27327a4c90
|
[example] add palm pytorch version (#2172)
|
2022-12-22 10:15:34 +08:00 |
|
HELSON
|
a7d95b7024
|
[example] add zero1, zero2 example in GPT examples (#2146)
* [example] add zero1 and zero2 for GPT
* update readme in gpt example
* polish code
* change init value
* update readme
|
2022-12-20 14:30:27 +08:00 |
|
ZijianYY
|
fa9d1aea71
|
[example] update GPT README (#2095)
|
2022-12-07 15:47:37 +08:00 |
|
mandoxzhang
|
52bd106627
|
add RoBERTa (#1980)
* update roberta
* update roberta & readme
* update roberta & readme
* update roberta & readme
|
2022-11-18 14:04:49 +08:00 |
|
Jiarui Fang
|
f7e276fa71
|
[Gemini] add GeminiAdamOptimizer (#1960)
|
2022-11-16 14:44:28 +08:00 |
|
Jiarui Fang
|
60abd86d6a
|
[example] enhance GPT demo (#1959)
* [example] enhence GPT demo
* Update README.md
Co-authored-by: binmakeswell <binmakeswell@gmail.com>
|
2022-11-16 11:36:27 +08:00 |
|
Jiarui Fang
|
a25f755331
|
[example] add TP to GPT example (#1828)
|
2022-11-08 17:17:19 +08:00 |
|
Jiarui Fang
|
b1263d32ba
|
[example] simplify the GPT2 huggingface example (#1826)
|
2022-11-08 16:14:07 +08:00 |
|
Jiarui Fang
|
cd5a0d56fa
|
[Gemini] make gemini usage simple (#1821)
|
2022-11-08 15:53:13 +08:00 |
|
Jiarui Fang
|
350ccc0481
|
[example] opt does not depend on Titans (#1811)
|
2022-11-08 12:02:20 +08:00 |
|
Jiarui Fang
|
203ca57aed
|
[example] add GPT
|
2022-11-08 10:58:17 +08:00 |
|
Jiarui Fang
|
fd2c8d8156
|
[example] add opt model in lauguage (#1809)
|
2022-11-08 10:39:13 +08:00 |
|