github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-08-23 02:06:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,874 Commits 58 Branches 51 Tags 237 MiB
feature/inference-refactor
Commit Graph

3 Commits

Author SHA1 Message Date
Xu Kai
c6295c3381
[Refactor] remove useless inference code (#5022) 
* remove useless code

* fix quant model

* fix test import bug

* mv original inference legacy

* fix chatglm2
 2023-11-10 14:47:06 +08:00
Bin Jia
48d0a58d10 add support for bloom (#5008) 2023-11-09 10:12:11 +08:00
Bin Jia
b6696beb04
[Pipeline Inference] Merge pp with tp (#4993) 
* refactor pipeline into new CaiInferEngine

* updata llama modeling forward

* merge tp with pp

* update docstring

* optimize test workflow and example

* fix typo

* add assert and todo
 2023-11-01 12:46:21 +08:00