Jiarui Fang 05e33b2578 [zero] fix grad offload (#528) ...

* [zero] fix grad offload

* polish code

2022-03-25 18:23:25 +08:00

..

__init__.py

[memory] add model data tensor moving api (#503)

2022-03-24 14:29:41 +08:00

bucket_tensor_copy.py

[memory] set cuda mem frac (#506)

2022-03-24 16:57:13 +08:00

memory_monitor.py

[zero] fix init device bug in zero init context unittest (#516)

2022-03-25 12:24:18 +08:00

utils.py

[zero] fix grad offload (#528)

2022-03-25 18:23:25 +08:00