Jiarui Fang 4a76084dc9 [tensor] add zero_like colo op, important for Optimizer (#1236)

2022-07-08 14:55:27 +08:00

..

_ops

[tensor] add zero_like colo op, important for Optimizer (#1236)

2022-07-08 14:55:27 +08:00

graph

[refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

layer

[pipeline] refactor the pipeline module (#1087)

2022-06-10 11:27:38 +08:00

loss

[tensor] add unitest for colo_tensor 1DTP cross_entropy (#1230)

2022-07-07 19:17:23 +08:00

lr_scheduler

[checkpoint]support generalized scheduler (#1222)

2022-07-07 18:16:38 +08:00

metric

[hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622)

2022-04-02 16:12:04 +08:00

optimizer

[optim] refactor fused sgd (#1134)

2022-06-20 11:19:38 +08:00

parallel

[refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

__init__.py

[pipeline] refactor the pipeline module (#1087)

2022-06-10 11:27:38 +08:00

init.py

Refactored docstring to google style

2022-03-29 17:17:47 +08:00