Jiarui Fang 56bb412e72 [polish] use GLOBAL_MODEL_DATA_TRACER (#417)

2022-03-15 11:29:46 +08:00

..

init_ctx

[polish] use GLOBAL_MODEL_DATA_TRACER (#417)

2022-03-15 11:29:46 +08:00

shard_utils

polish code

2022-03-14 15:48:55 +08:00

sharded_model

[zero] memtracer to record cuda memory usage of model data and overall system (#395)

2022-03-14 22:05:30 +08:00

sharded_optim

[zero] refactory ShardedOptimV2 init method (#416)

2022-03-15 10:45:55 +08:00

sharded_param

[zero] find miss code (#378)

2022-03-11 15:50:28 +08:00

__init__.py

added buffer sync to naive amp model wrapper (#291)

2022-03-11 15:50:28 +08:00