Files
ColossalAI/colossalai/kernel/op_builder/__init__.py
Jiarui Fang 1cb532ffec [builder] multihead attn runtime building (#2203)
* [hotfix] correcnt cpu_optim runtime compilation

* [builder] multihead attn

* fix bug

* fix a bug
2022-12-27 16:06:09 +08:00

6 lines
205 B
Python

from .cpu_adam import CPUAdamBuilder
from .fused_optim import FusedOptimBuilder
from .multi_head_attn import MultiHeadAttnBuilder
__all__ = ['CPUAdamBuilder', 'FusedOptimBuilder', 'MultiHeadAttnBuilder']