mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-08-14 14:13:22 +00:00
c6295c3381
* remove useless code * fix quant model * fix test import bug * mv original inference legacy * fix chatglm2
3 lines
90 B
Python
3 lines
90 B
Python
from .batch_infer_state import BatchInferState
|
|
from .kvcache_manager import MemoryManager
|