[auto-parallel] add auto-offload feature (#3154)

Browse Source

* add auto-offload feature

* polish code

* fix syn offload runtime pass bug

* add offload example

* fix offload testing bug

* fix example testing bug

...

This commit is contained in:

Zihao

2023-03-21 14:17:41 +08:00

committed by GitHub

parent 258b43317c

commit 18dbe76cae

18 changed files with 2833 additions and 0 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

0

colossalai/auto_parallel/offload/__init__.py Normal file