Frank Lee e79ea44247 [fp16] refactored fp16 optimizer (#392)

2022-03-15 10:05:38 +08:00

..

init_ctx

[zero] memtracer to record cuda memory usage of model data and overall system (#395)

2022-03-14 22:05:30 +08:00

shard_utils

polish code

2022-03-14 15:48:55 +08:00

sharded_model

[zero] memtracer to record cuda memory usage of model data and overall system (#395)

2022-03-14 22:05:30 +08:00

sharded_optim

[fp16] refactored fp16 optimizer (#392)

2022-03-15 10:05:38 +08:00

sharded_param

[zero] find miss code (#378)

2022-03-11 15:50:28 +08:00

__init__.py

added buffer sync to naive amp model wrapper (#291)

2022-03-11 15:50:28 +08:00