github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-04-12 07:02:22 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
406443200fcfc087655683d78ce65bddde6d3be2
ColossalAI/examples/inference
History
Yuanheng Zhao 677cbfacf8 [Fix/Example] Fix Llama Inference Loading Data Type (#5763) 
* [fix/example] fix llama inference loading dtype

* revise loading dtype of benchmark llama3
2024-05-30 13:48:46 +08:00
..
benchmark_ops
add paged-attetionv2: support seq length split across thread block (#5707)
2024-05-14 12:46:54 +08:00
client
[Inference]Fix readme and example for API server (#5742)
2024-05-24 10:03:05 +08:00
llama
[Fix/Example] Fix Llama Inference Loading Data Type (#5763)
2024-05-30 13:48:46 +08:00