yuehuayingxueluo
|
5f00002e43
|
[Inference] Adapt Baichuan2-13B TP (#5659)
* adapt to baichuan2 13B
* add baichuan2 13B TP
* update baichuan tp logic
* rm unused code
* Fix TP logic
* fix alibi slopes tp logic
* rm nn.Module
* Polished the code.
* change BAICHUAN_MODEL_NAME_OR_PATH
* Modified the logic for loading Baichuan weights.
* fix typos
|
2024-04-30 15:47:07 +08:00 |
|