github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-01 17:17:05 +00:00
Code Issues Packages Projects Releases Wiki Activity

[example] fixed opt model downloading from huggingface

Browse Source
This commit is contained in:
Tomek
2023-03-09 03:47:41 +01:00
committed by GitHub
parent 2ca9728cbb
commit af3888481d
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/language/opt/train_gemini_opt.py
View File

@@ -177,7 +177,7 @@ def main():
default_dist_spec = ShardSpec([-1], [world_size]) if args.shardinit else None
# build model
if args.model_name_or_path is None or args.model_name_or_path == 'facebook/opt-13b':
if args.model_name_or_path is None:
# currently, there has a bug in pretrained opt-13b
# we can not import it until huggingface fix it
logger.info("Train a new model from scratch", ranks=[0])