Yuanheng Zhao 7b249c76e5 [Fix] Fix spec-dec Glide LlamaModel for compatibility with transformers (#5837) ...

* fix glide llama model

* revise

2024-06-19 15:37:53 +08:00

..

__init__.py

fix bugs in request_handler

2024-01-11 13:39:56 +00:00

glide_llama.py

[Fix] Fix spec-dec Glide LlamaModel for compatibility with transformers (#5837)

2024-06-19 15:37:53 +08:00

nopadding_baichuan.py

[Inference] Fix flash-attn import and add model test (#5794)

2024-06-12 14:13:50 +08:00

nopadding_llama.py

[Inference] Fix flash-attn import and add model test (#5794)

2024-06-12 14:13:50 +08:00