github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-16 07:28:45 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
43ad0d9ef031c3c102ae5eee2378ee7fc3910090
ColossalAI/examples/inference/serving
History
Zhongkai Zhao 70885d707d [hotfix] Suport extra_kwargs in ShardConfig (#5031) 
* [refactor]: replace inference args with extra_kwargs in ShardConfig

* modify shardconfig

* polish code

* fix policy bug in llama

* fix bug in auto policy

* remove setattr in ShardConfig
2023-11-10 10:49:50 +08:00
..
ray_serve
[hotfix] Suport extra_kwargs in ShardConfig (#5031)
2023-11-10 10:49:50 +08:00
torch_serve
[hotfix] Suport extra_kwargs in ShardConfig (#5031)
2023-11-10 10:49:50 +08:00
test_ci.sh
[Infer] Colossal-Inference serving example w/ TorchServe (single GPU case) (#4771)
2023-10-02 17:42:37 +08:00