github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-15 23:23:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
8ea50d999eaad11c614c103835bf42e99f9a3fbd
ColossalAI/colossalai/zero
History
HELSON a7d95b7024 [example] add zero1, zero2 example in GPT examples (#2146) 
* [example] add zero1 and zero2 for GPT

* update readme in gpt example

* polish code

* change init value

* update readme
2022-12-20 14:30:27 +08:00
..
init_ctx
[moe] fix MoE bugs (#1628)
2022-09-22 13:56:30 +08:00
shard_utils
[gemini] add GeminiMemoryManger (#832)
2022-04-24 13:08:48 +08:00
sharded_model
[Gemini] update API of the chunkmemstatscollector. (#2129)
2022-12-14 00:47:06 +08:00
sharded_optim
[example] add zero1, zero2 example in GPT examples (#2146)
2022-12-20 14:30:27 +08:00
sharded_param
[NFC] polish colossalai/zero/sharded_param/__init__.py code style (#1717)
2022-10-19 12:20:51 +08:00
utils
[Gemini] update API of the chunkmemstatscollector. (#2129)
2022-12-14 00:47:06 +08:00
__init__.py
[Gemini] add GeminiAdamOptimizer (#1960)
2022-11-16 14:44:28 +08:00