yuehuayingxueluo 3c91e3f176 [Inference]Adapt to baichuan2 13B (#5614) ...

* adapt to baichuan2 13B

* adapt to baichuan2 13B

* change BAICHUAN_MODEL_NAME_OR_PATH

* fix test_decoding_attn.py

* Modifications based on review comments.

* change BAICHUAN_MODEL_NAME_OR_PATH

* mv attn mask processes to test flash decoding

* mv get_alibi_slopes baichuan modeling

* fix bugs in test_baichuan.py

2024-04-25 23:11:30 +08:00

..

__init__.py

[Inference] Add CacheBlock and KV-Cache Manager (#5156)

2024-01-11 13:39:29 +00:00

block_cache.py

[doc] updated inference readme (#5343)

2024-02-02 14:31:10 +08:00

kvcache_manager.py

[Inference]Adapt to baichuan2 13B (#5614)

2024-04-25 23:11:30 +08:00