ver217 f68eddfb3d refactor kernel (#142)

2022-01-13 16:47:17 +08:00

..

__init__.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

colossalai_optimizer.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

fused_adam.py

refactor kernel (#142)

2022-01-13 16:47:17 +08:00

fused_lamb.py

refactor kernel (#142)

2022-01-13 16:47:17 +08:00

fused_sgd.py

refactor kernel (#142)

2022-01-13 16:47:17 +08:00

lamb.py

add an example of ViT-B/16 and remove w_norm clipping in LAMB (#29)

2021-11-18 23:45:09 +08:00

lars.py

update documentation

2021-10-29 09:29:20 +08:00