github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-07-13 03:38:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
56e75eeb063279fbc0fc84e25f267f1ca208e784
ColossalAI/colossalai/inference/core
History
Jianghai 56e75eeb06 [Inference] Add readme (roadmap) and fulfill request handler (#5147) 
* request handler

* add readme

---------

Co-authored-by: CjhHa1 <cjh18671720497outlook.com>
2024-01-11 13:39:29 +00:00
..
cache_manager.py
[Inference] First PR for rebuild colossal-infer (#5143)
2024-01-11 13:39:29 +00:00
engine.py
[Inference] First PR for rebuild colossal-infer (#5143)
2024-01-11 13:39:29 +00:00
request_handler.py
[Inference] Add readme (roadmap) and fulfill request handler (#5147)
2024-01-11 13:39:29 +00:00