HELSON 7544347145 [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469)

2022-03-21 13:35:04 +08:00

..

commons

[hotfix] fix initialize bug with zero (#442)

2022-03-17 13:16:22 +08:00

data_sampler

fixed utils docstring and add example to readme (#200)

2022-02-03 11:37:17 +08:00

gradient_accumulation

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00

memory_tracer

fixed mem monitor device (#433)

2022-03-16 15:25:02 +08:00

multi_tensor_apply

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00

profiler

fixed error when no collective communication in CommProfiler

2022-03-14 17:21:00 +08:00

tensor_detector

Added tensor detector (#393)

2022-03-14 18:01:46 +08:00

__init__.py

Added tensor detector (#393)

2022-03-14 18:01:46 +08:00

activation_checkpoint.py

Added activation offload (#331)

2022-03-11 15:50:28 +08:00

checkpointing.py

fixed mkdir conflict and align yapf config with flake (#220)

2022-02-15 11:31:13 +08:00

common.py

[MOE] add unitest for MOE experts layout, gradient handler and kernel (#469)

2022-03-21 13:35:04 +08:00

cuda.py

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00

memory.py

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00

moe.py

[MOE] polish moe_env (#467)

2022-03-19 15:36:25 +08:00

timer.py

[profiler] primary memory tracer

2022-03-11 15:50:28 +08:00