github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-08-15 06:33:16 +00:00
Code Issues Packages Projects Releases Wiki Activity
feature/inference-refactor
ColossalAI/colossalai/legacy/inference/tensor_parallel
History
Xu Kai c6295c3381
[Refactor] remove useless inference code (#5022) 
* remove useless code

* fix quant model

* fix test import bug

* mv original inference legacy

* fix chatglm2
2023-11-10 14:47:06 +08:00
..
modeling [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
policies [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
__init__.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
batch_infer_state.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
engine.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
kvcache_manager.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00