github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-02-21 06:22:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
677cbfacf8ef11f423ec1f5216083675615ab85d
ColossalAI/examples/inference
History
Yuanheng Zhao 677cbfacf8 [Fix/Example] Fix Llama Inference Loading Data Type (#5763) 
* [fix/example] fix llama inference loading dtype

* revise loading dtype of benchmark llama3
2024-05-30 13:48:46 +08:00
..
benchmark_ops
add paged-attetionv2: support seq length split across thread block (#5707)
2024-05-14 12:46:54 +08:00
client
[Inference]Fix readme and example for API server (#5742)
2024-05-24 10:03:05 +08:00
llama
[Fix/Example] Fix Llama Inference Loading Data Type (#5763)
2024-05-30 13:48:46 +08:00