Hongxin Liu 1cd7efc520 [inference] refactor examples and fix schedule (#5077) ...

* [setup] refactor infer setup

* [hotfix] fix infenrece behavior on 1 1 gpu

* [exmaple] refactor inference examples

2023-11-21 10:46:03 +08:00

..

requirements-infer.txt

[inference] refactor examples and fix schedule (#5077)

2023-11-21 10:46:03 +08:00

requirements-test.txt

[Kernels]Update triton kernels into 2.1.0 (#5046)

2023-11-16 16:43:15 +08:00

requirements.txt

[Inference] Dynamic Batching Inference, online and offline (#4953)

2023-10-30 10:52:19 +08:00