github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-01 17:17:05 +00:00
Code Issues Packages Projects Releases Wiki Activity

[shardformer] shardformer support opt models (#4091)

Browse Source 
* [shardformer] shardformer support opt models

* [shardformer] shardformer support opt models, fix

* [shardformer] shardformer support opt models, fix

* [shardformer] shardformer support opt models, fix
This commit is contained in:
jiangmingyan
2023-06-27 17:39:29 +08:00
committed by Frank Lee
parent d33a44e8c3
commit ac80937138
6 changed files with 264 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
tests/test_fx/test_tracer/test_hf_model/test_hf_opt.py
View File

@@ -11,10 +11,9 @@ from tests.kit.model_zoo import model_zoo
@clear_cache_before_run()
def test_opt():
sub_registry = model_zoo.get_sub_registry('transformers_opt')
for name, (model_fn, data_gen_fn, _, _, _) in sub_registry.items():
model = model_fn()
trace_model_and_compare_output(model, data_gen_fn)
trace_model_and_compare_output(model, data_gen_fn, ignore_data=['labels', 'start_positions', 'end_positions'])
if __name__ == '__main__':