mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-08-08 19:38:05 +00:00
34966378e8
* add functions for gpt evaluation * add automatic eval Update eval.py * using jload and modify the type of answers1 and answers2 * Update eval.py Update eval.py * Update evaluator.py * support gpt evaluation * update readme.md update README.md update READNE.md modify readme.md * add Chinese example for config, battle prompt and evaluation prompt file * remove GPT-4 config * remove sample folder --------- Co-authored-by: Yuanchen Xu <yuanchen.xu00@gmail.com> Co-authored-by: Camille Zhong <44392324+Camille7777@users.noreply.github.com>
10 lines
466 B
Bash
Executable File
10 lines
466 B
Bash
Executable File
python eval.py \
|
|
--config_file "path to the config file" \
|
|
--battle_prompt_file "path to the prompt file for battle" \
|
|
--gpt_evaluation_prompt_file "path to the prompt file for gpt evaluation" \
|
|
--target_file "path to the target answer file" \
|
|
--answer_file_list "path to the answer files of at most 2 models" \
|
|
--model_name_list "the names of at most 2 models" \
|
|
--save_path "path to save results" \
|
|
--openai_key "your openai key" \
|