mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-05-04 14:38:10 +00:00
cefdc32615
* Support GSM, Data Leakage Evaluation and Tensor Parallel * remove redundant code and update inference.py in examples/gpt_evaluation --------- Co-authored-by: Xu Yuanchen <yuanchen.xu00@gmail.com>
6 lines
178 B
Bash
6 lines
178 B
Bash
torchrun --nproc_per_node=1 inference.py \
|
|
--config "path to config file" \
|
|
--load_dataset \
|
|
--tp_size 1 \
|
|
--inference_save_path "path to save inference results"
|