yuehuayingxueluo 5f00002e43 [Inference] Adapt Baichuan2-13B TP (#5659) ...

* adapt to baichuan2 13B

* add baichuan2 13B TP

* update baichuan tp logic

* rm unused code

* Fix TP logic

* fix alibi slopes tp logic

* rm nn.Module

* Polished the code.

* change BAICHUAN_MODEL_NAME_OR_PATH

* Modified the logic for loading Baichuan weights.

* fix typos

2024-04-30 15:47:07 +08:00

..

__init__.py

[inference/model]Adapted to the baichuan2-7B model (#5591)

2024-04-15 16:53:02 +08:00

glide_llama.py

[Inference/SpecDec] Support GLIDE Drafter Model (#5455)

2024-04-10 11:07:52 +08:00

nopadding_baichuan.py

[Inference] Adapt Baichuan2-13B TP (#5659)

2024-04-30 15:47:07 +08:00

nopadding_llama.py

[example] Update Llama Inference example (#5629)

2024-04-23 22:23:07 +08:00