Commit Graph

2 Commits

Author SHA1 Message Date
Hongxin Liu
27e62ba0f7 [inference] decouple pp logic for llama (#5092)
* [example] update inference benchmark

* [inference] decouple pp logic for llama

* [inference] update examples
2023-11-22 13:53:08 +08:00
Zhongkai Zhao
79c4bff452 [doc] Update the user guide and the development document in Colossal-Inference (#5086)
* doc/ Update the user guide and the development document

* update quick start example and readme
2023-11-21 18:58:04 +08:00