Files
ColossalAI/colossalai/inference/flash_decoding_utils.py
Jianghai 1f8c7e7046 [Inference] User Experience: update the logic of default tokenizer and generation config. (#5337)
* add

* fix

* fix

* pause

* fix

* fix pytest

* align

* fix

* license

* fix

* fix

* fix readme

* fix some bugs

* remove tokenizer config
2024-02-07 17:55:48 +08:00

2.4 KiB