FoolPlayer 8d68de767d [shardformer] init shardformer code structure (#3731) ...

* init shardformer code structure

* add implement of sharder (inject and replace)

* add implement of replace layer to colossal layer

* separate different layer policy, add some notion

* implement 1d and 2d slicer, can tell col or row

* fix bug when slicing and inject model

* fix some bug; add inference test example

2023-07-04 16:05:01 +08:00

0 lines

Python

Raw Permalink Blame History