github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-08-15 06:33:16 +00:00
Code Issues Packages Projects Releases Wiki Activity
feature/inference-refactor
ColossalAI/colossalai/legacy/inference/dynamic_batching
History
Xu Kai c6295c3381
[Refactor] remove useless inference code (#5022) 
* remove useless code

* fix quant model

* fix test import bug

* mv original inference legacy

* fix chatglm2
2023-11-10 14:47:06 +08:00
..
__init__.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
get_tokenizer.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
infer_batch.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
io_struct.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
ray_dist_init.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
ray_init_config.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
req_queue.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
sampling_params.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00
stats.py [Refactor] remove useless inference code (#5022) 2023-11-10 14:47:06 +08:00