yuehuayingxueluo 04aca9e55b [Inference/Kernel]Add get_cos_and_sin Kernel (#5528) ...

* Add get_cos_and_sin kernel

* fix code comments

* fix code typos

* merge common codes of get_cos_and_sin kernel.

* Fixed a typo

* Changed 'asset allclose' to 'assert equal'.

2024-04-01 13:47:14 +08:00

..

layers

[Inference]Fused the gate and up proj in mlp，and optimized the autograd process. (#5365)

2024-02-06 19:38:25 +08:00

models

[Inference/Kernel]Add get_cos_and_sin Kernel (#5528)

2024-04-01 13:47:14 +08:00

policy

feat rmsnorm cuda kernel and add unittest, benchmark script (#5417)

2024-03-08 16:21:12 +08:00

__init__.py

[doc] updated inference readme (#5343)

2024-02-02 14:31:10 +08:00