github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-04-11 22:54:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
bfff9254ac8ca866673746ec47cfd2f87aab2b66
ColossalAI/colossalai/inference/modeling
History
yuehuayingxueluo bfff9254ac [inference] Adapted to Rotary Embedding and RMS Norm (#5283) 
* adapted to rotary_embedding

* adapted to nopad rms norm

* fix bugs in benchmark

* fix flash_decoding.py
2024-01-22 10:55:34 +08:00
..
layers
[Hotfix] Fix bugs in testing continuous batching (#5270)
2024-01-18 16:31:14 +08:00
models
[inference] Adapted to Rotary Embedding and RMS Norm (#5283)
2024-01-22 10:55:34 +08:00
policy
[inference] Adapted to Rotary Embedding and RMS Norm (#5283)
2024-01-22 10:55:34 +08:00