github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-02-22 06:52:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b2ad0d9e8f1be0bcfab886ef1420bb5fdb3987de
ColossalAI/examples/inference/serving
History
Zhongkai Zhao 70885d707d [hotfix] Suport extra_kwargs in ShardConfig (#5031) 
* [refactor]: replace inference args with extra_kwargs in ShardConfig

* modify shardconfig

* polish code

* fix policy bug in llama

* fix bug in auto policy

* remove setattr in ShardConfig
2023-11-10 10:49:50 +08:00
..
ray_serve
[hotfix] Suport extra_kwargs in ShardConfig (#5031)
2023-11-10 10:49:50 +08:00
torch_serve
[hotfix] Suport extra_kwargs in ShardConfig (#5031)
2023-11-10 10:49:50 +08:00
test_ci.sh
[Infer] Colossal-Inference serving example w/ TorchServe (single GPU case) (#4771)
2023-10-02 17:42:37 +08:00