github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-05-14 18:56:53 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
f196f40a8f9580a2a03352bb15b48c6a7b444691
ColossalAI/colossalai/inference/engine
History
Hongxin Liu f196f40a8f [inference] decouple pipeline logci for chatglm (#5098) 
* [inference] decouple pipeline logci for chatglm

* [inference] fix chatglm modeling
2023-11-22 18:26:39 +08:00
..
modeling
[inference] decouple pipeline logci for chatglm (#5098)
2023-11-22 18:26:39 +08:00
policies
[hotfix]fix chatglm rmsnorm (#5079)
2023-11-22 17:59:22 +08:00
__init__.py
[inference] update examples and engine (#5073)
2023-11-20 19:44:52 +08:00
engine.py
[inference] decouple pipeline logci for chatglm (#5098)
2023-11-22 18:26:39 +08:00
microbatch_manager.py
[inference] Refactor inference architecture (#5057)
2023-11-19 21:05:05 +08:00