Files
ColossalAI/examples/inference/llama/benchmark_llama3.py
Yuanheng Zhao 677cbfacf8 [Fix/Example] Fix Llama Inference Loading Data Type (#5763)
* [fix/example] fix llama inference loading dtype

* revise loading dtype of benchmark llama3
2024-05-30 13:48:46 +08:00

8.1 KiB