github/DB-GPT
1
0
Fork 0
mirror of https://github.com/csunny/DB-GPT.git synced 2025-09-05 11:01:09 +00:00
Code Issues Packages Projects Releases Wiki Activity

feat(model): Add more support model list and modify LLM benchmarks (#823)

Browse Source
This commit is contained in:
FangYin Cheng
2023-11-23 10:13:59 +08:00
committed by GitHub
parent e4c91d161f
commit 89dcccc642
9 changed files with 207 additions and 16 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
scripts/run_llm_benchmarks.sh
View File

@@ -1,7 +1,7 @@
#!/bin/bash
default_input_lens="64,64,64,512,1024,1024,2048"
default_output_lens="256,512,1024,1024,1024,2048,2048"
default_input_lens="8,8,256,1024"
default_output_lens="256,512,1024,1024"
default_parallel_nums="1,2,4,16,32"
input_lens=${1:-$default_input_lens}