ColossalAI/colossalai/legacy/inference/hybridengine/__init__.py
Xu Kai c6295c3381
[Refactor] remove useless inference code (#5022)
* remove useless code

* fix quant model

* fix test import bug

* mv original inference legacy

* fix chatglm2
2023-11-10 14:47:06 +08:00

4 lines
65 B
Python

from .engine import CaiInferEngine
__all__ = ["CaiInferEngine"]