[fix] rm use_zbv flag in Shardconfig; rm debug info;

This commit is contained in:
duanjunwen
2024-10-16 03:25:04 +00:00
parent 90939b77e0
commit e76308c6e6
9 changed files with 212 additions and 651 deletions

View File

@@ -277,7 +277,7 @@ def check_forward_backward(model_fn, data_gen_fn, output_transform_fn, loss_fn,
"precision": "fp16",
"initial_scale": 1,
},
# TODO: assert layer error
# # TODO: assert layer error
# {
# "tp_size": 2,
# "pp_size": 2,