LuGY 6a3f9fda83 [cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497)

2022-03-25 14:15:53 +08:00

..

csrc

[cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497)

2022-03-25 14:15:53 +08:00

__init__.py

refactor kernel (#142)

2022-01-13 16:47:17 +08:00

layer_norm.py

[formart] format fixed for kernel\cuda_native codes (#335)

2022-03-11 15:50:28 +08:00

multihead_attention.py

[formart] format fixed for kernel\cuda_native codes (#335)

2022-03-11 15:50:28 +08:00

scaled_softmax.py

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00