github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-08 20:40:34 +00:00
Code Issues Packages Projects Releases Wiki Activity

refactor kernel (#142)

Browse Source
This commit is contained in:
ver217
2022-01-13 16:47:17 +08:00
committed by GitHub
parent 4a3d3446b0
commit f68eddfb3d
24 changed files with 334 additions and 414 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
colossalai/kernel/__init__.py
View File

@@ -1,8 +1,5 @@
from .jit.bias_dropout_add import bias_dropout_add_fused_train, bias_dropout_add_fused_inference
from .jit.bias_gelu import bias_gelu_impl
from .cuda_native import LayerNorm, FusedScaleMaskSoftmax, MultiHeadAttention
__all__ = [
"bias_dropout_add_fused_train", "bias_dropout_add_fused_inference", "bias_gelu_impl",
"LayerNorm", "FusedScaleMaskSoftmax", "MultiHeadAttention"
]