github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-08-14 14:13:22 +00:00
Code Issues Packages Projects Releases Wiki Activity
feature/inference-refactor
ColossalAI/colossalai/inference/kvcache_manager
History
Xu Kai c6295c3381
[Refactor] remove useless inference code (#5022) 
* remove useless code

* fix quant model

* fix test import bug

* mv original inference legacy

* fix chatglm2
2023-11-10 14:47:06 +08:00
..
__init__.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
batch_infer_state.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
kvcache_manager.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00