Files
ColossalAI/colossalai/inference/pipeline/__init__.py
Bin Jia b6696beb04 [Pipeline Inference] Merge pp with tp (#4993)
* refactor pipeline into new CaiInferEngine

* updata llama modeling forward

* merge tp with pp

* update docstring

* optimize test workflow and example

* fix typo

* add assert and todo
2023-11-01 12:46:21 +08:00

4 lines
83 B
Python

from .microbatch_manager import MicroBatchManager
__all__ = ["MicroBatchManager"]