yuehuayingxueluo e8f0642f28 [Inference]Add Nopadding Llama Modeling (#5327) ...

* add nopadding llama modeling

* add nopadding_llama.py

* rm unused codes

* fix bugs in test_xine_copy.py

* fix code style

2024-01-30 10:31:46 +08:00

..

engine.py

[Inference]Add Nopadding Llama Modeling (#5327)

2024-01-30 10:31:46 +08:00

request_handler.py

[inference]Optimize the usage of the mid tensors space in flash attn (#5304)

2024-01-26 14:00:10 +08:00