Camille Zhong cd6a962e66 [NFC] polish code style (#4799)

2023-10-07 13:36:52 +08:00

..

gptq

[NFC] polish code style (#4799)

2023-10-07 13:36:52 +08:00

kernels

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

colossal_C_frontend.cpp

[optimizer] add div_scale for optimizers (#2117)

2022-12-12 17:58:57 +08:00

compat.h

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

cpu_adam.cpp

[hotfix] fix CPUAdam kernel nullptr (#1410)

2022-08-05 19:45:45 +08:00

cpu_adam.h

[hotfix] fix CPUAdam kernel nullptr (#1410)

2022-08-05 19:45:45 +08:00

layer_norm_cuda_kernel.cu

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

layer_norm_cuda.cpp

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

moe_cuda_kernel.cu

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

moe_cuda.cpp

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

multi_tensor_adam.cu

[doc] add deepspeed citation and copyright (#2996)

2023-03-04 20:08:11 +08:00

multi_tensor_apply.cuh

[doc] add deepspeed citation and copyright (#2996)

2023-03-04 20:08:11 +08:00

multi_tensor_l2norm_kernel.cu

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

multi_tensor_lamb.cu

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

multi_tensor_scale_kernel.cu

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

multi_tensor_sgd_kernel.cu

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

multihead_attention_1d.cpp

[hotfix] fix error for torch 2.0 (#2243)

2022-12-30 23:11:55 +08:00

multihead_attention_1d.h

[hotfix] fix error for torch 2.0 (#2243)

2022-12-30 23:11:55 +08:00

scaled_masked_softmax_cuda.cu

[NFC] polish colossalai/kernel/cuda_native/csrc/scaled_masked_softmax_cuda.cu code style (#949)

2022-05-17 10:25:06 +08:00

scaled_masked_softmax.cpp

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

scaled_masked_softmax.h

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

scaled_upper_triang_masked_softmax_cuda.cu

[NFC] polish pre-commit run --files colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu code style (#943)

2022-05-17 10:25:06 +08:00

scaled_upper_triang_masked_softmax.cpp

[NFC] polish colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp code style (#959)

2022-05-17 10:25:06 +08:00

scaled_upper_triang_masked_softmax.h

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

type_shim.h

[bf16] add bf16 support (#3882)

2023-06-05 15:58:31 +08:00