Yuanheng Zhao 04863a9b14 [example] Update Llama Inference example (#5629) ...

* [example] add infernece benchmark llama3

* revise inference config - arg

* remove unused args

* add llama generation demo script

* fix init rope in llama policy

* add benchmark-llama3 - cleanup

2024-04-23 22:23:07 +08:00

..

layers

[Inference]Fused the gate and up proj in mlp，and optimized the autograd process. (#5365)

2024-02-06 19:38:25 +08:00

models

[Fix/Inference] Fix GQA Triton and Support Llama3 (#5624)

2024-04-23 13:09:55 +08:00

policy

[example] Update Llama Inference example (#5629)

2024-04-23 22:23:07 +08:00

__init__.py

[doc] updated inference readme (#5343)

2024-02-02 14:31:10 +08:00