github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-08 04:24:47 +00:00
Code Issues Packages Projects Releases Wiki Activity

[pipeline] move bert related pipeline components to shardformer (#4187)

Browse Source 
* move bert related pipeline components to shardformer

* fix bugs

* revision

* fix bert model tests

* fix bert_lm_head model tests

* fix tests

* fix tests

* done checks

* skip bloom
This commit is contained in:
Jianghai
2023-07-07 15:41:00 +08:00
committed by Hongxin Liu
parent c5ea728016
commit f3bcc292c8
9 changed files with 556 additions and 65 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
tests/test_shardformer/test_layer/test_layernorm.py
View File

@@ -41,4 +41,4 @@ def test_layernorm():
if __name__ == '__main__':
test_layernorm_1d()
test_layernorm()