shenggan 5c3843dc98 add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

..

kernels

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

compat.h

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

layer_norm_cuda_kernel.cu

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

layer_norm_cuda.cpp

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

multihead_attention_1d.cpp

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

multihead_attention_1d.h

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

scaled_masked_softmax_cuda.cu

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

scaled_masked_softmax.cpp

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

scaled_masked_softmax.h

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

scaled_upper_triang_masked_softmax_cuda.cu

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

scaled_upper_triang_masked_softmax.cpp

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

scaled_upper_triang_masked_softmax.h

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00

type_shim.h

add colossalai kernel module (#55)

2021-12-21 12:19:52 +08:00