github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-18 16:00:49 +00:00
Code Issues Packages Projects Releases Wiki Activity

[bugs] hot fix some testing bugs for new models (#4268)

Browse Source 
* hot fix

* hot fx tracer
This commit is contained in:
Jianghai
2023-07-18 11:42:58 +08:00
committed by Hongxin Liu
parent 34f0e34a4c
commit d9be0472ef
4 changed files with 4 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
tests/test_shardformer/test_model/test_pure_pipeline.py
View File

@@ -122,9 +122,7 @@ def run_llama_test(enable_fused_normalization, enable_tensor_parallelism, use_la
2: [2, 3],
3: [2, 3],
}
from datasets import load_dataset
#dataset = load_dataset("open_subtitles", lang1="fi", lang2="hi")
pg_mesh = ProcessGroupMesh(PP_SIZE)
stage_manager = PipelineStageManager(pg_mesh, PP_DIM)
sub_model_zoo = model_zoo.get_sub_registry('transformers_llama')