Files
ColossalAI/colossalai/inference/tensor_parallel/__init__.py
Hongxin Liu 079bf3cb26 [misc] update pre-commit and run all files (#4752)
* [misc] update pre-commit

* [misc] run pre-commit

* [misc] remove useless configuration files

* [misc] ignore cuda for clang-format
2023-09-19 14:20:26 +08:00

5 lines
123 B
Python

from .engine import TPInferEngine
from .kvcache_manager import MemoryManager
__all__ = ["MemoryManager", "TPInferEngine"]