github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-04-29 04:05:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,842 Commits 42 Branches 49 Tags 232 MiB
9df4a8047a
Commit Graph

2 Commits

Author SHA1 Message Date
Yuanheng Zhao
677cbfacf8
[Fix/Example] Fix Llama Inference Loading Data Type (#5763) 
* [fix/example] fix llama inference loading dtype

* revise loading dtype of benchmark llama3
 2024-05-30 13:48:46 +08:00
Yuanheng Zhao
55cc7f3df7
[Fix] Fix Inference Example, Tests, and Requirements (#5688) 
* clean requirements

* modify example inference struct

* add test ci scripts

* mark test_infer as submodule

* rm deprecated cls & deps

* import of HAS_FLASH_ATTN

* prune inference tests to be run

* prune triton kernel tests

* increment pytest timeout mins

* revert import path in openmoe
 2024-05-08 11:30:15 +08:00