github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-05-04 01:48:43 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,793 Commits 62 Branches 51 Tags
cd38167c1a4742ac3810b98ff13be0ab64fbeb9c
Commit Graph

1189 Commits

Author SHA1 Message Date
Jiarui Fang
93f62dd152 [autochunk] add autochunk feature 2023-01-10 16:04:42 +08:00
HELSON
dddacd2d2c [hotfix] add norm clearing for the overflow step (#2416) 2023-01-10 15:43:06 +08:00
oahzxl
7ab2db206f adapt new fx 2023-01-10 11:56:00 +08:00
oahzxl
e532679c95 Merge branch 'main' of https://github.com/oahzxl/ColossalAI into chunk 2023-01-10 11:29:01 +08:00
Haofan Wang
7d5640b9db Update parallel_context.py (#2408) 2023-01-10 11:27:23 +08:00
oahzxl
fd818cf144 change imports 2023-01-10 11:10:45 +08:00
oahzxl
a591d45b29 add available 2023-01-10 10:56:39 +08:00
oahzxl
615e7e68d9 update doc 2023-01-10 10:44:07 +08:00
oahzxl
7d4abaa525 add doc 2023-01-10 09:59:47 +08:00
oahzxl
1be0ac3cbf add doc for trace indice 2023-01-09 17:59:52 +08:00
oahzxl
0b6af554df remove useless function 2023-01-09 17:46:43 +08:00
oahzxl
d914a21d64 rename 2023-01-09 17:45:36 +08:00
oahzxl
865f2e0196 rename 2023-01-09 17:42:25 +08:00
HELSON
ea13a201bb [polish] polish code for get_static_torch_model (#2405) 
* [gemini] polish code

* [testing] remove code

* [gemini] make more robust
 2023-01-09 17:41:38 +08:00
oahzxl
a4ed5b0d0d rename in doc 2023-01-09 17:41:26 +08:00
oahzxl
1bb1f2ad89 rename 2023-01-09 17:38:16 +08:00
oahzxl
cb9817f75d rename function from index to indice 2023-01-09 17:34:30 +08:00
oahzxl
0ea903b94e rename trace_index to trace_indice 2023-01-09 17:25:13 +08:00
Frank Lee
551cafec14 [doc] updated kernel-related optimisers' docstring (#2385) 
* [doc] updated kernel-related optimisers' docstring

* polish doc
 2023-01-09 17:13:53 +08:00
oahzxl
065f0b4c27 add doc for search 2023-01-09 17:11:51 +08:00
oahzxl
a68d240ed5 add doc for search chunk 2023-01-09 16:54:08 +08:00
oahzxl
1951f7fa87 code style 2023-01-09 16:30:16 +08:00
oahzxl
212b5b1b5f add comments 2023-01-09 16:29:33 +08:00
oahzxl
19cc64b1d3 remove autochunk_available 2023-01-09 16:06:58 +08:00
eric8607242
9880fd2cd8 Fix state_dict key missing issue of the ZeroDDP (#2363) 
* Fix state_dict output for ZeroDDP duplicated parameters

* Rewrite state_dict based on get_static_torch_model

* Modify get_static_torch_model to be compatible with the lower version (ZeroDDP)
 2023-01-09 14:35:14 +08:00
oahzxl
4d223e18a2 fix typo 2023-01-09 13:46:17 +08:00
Frank Lee
ce08661eb1 [cli] updated installation check cli for aot/jit build (#2395) 2023-01-09 11:05:27 +08:00
jiaruifang
69d9180c4b [hotfix] issue #2388 2023-01-07 18:23:02 +08:00
Jiarui Fang
4e96039649 [device] find best logical mesh 2023-01-07 14:04:30 +08:00
Jiarui Fang
8f72b6f8fb [hotfix] fix implement error in diffusers 2023-01-07 07:56:39 +08:00
Frank Lee
40d376c566 [setup] support pre-build and jit-build of cuda kernels (#2374) 
* [setup] support pre-build and jit-build of cuda kernels

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
 2023-01-06 20:50:26 +08:00
1SAA
33f3023e19 [hotfix] fix implement error in diffusers 2023-01-06 18:37:18 +08:00
Jiarui Fang
12c8bf38d7 [Pipeline] Refine GPT PP Example 2023-01-06 18:03:45 +08:00
oahzxl
8a989a0d89 code style 2023-01-06 17:55:22 +08:00
oahzxl
c3a2bf48b4 code style 2023-01-06 17:31:59 +08:00
oahzxl
a6cdbf9161 seperate trace flow 2023-01-06 17:24:23 +08:00
oahzxl
4748967fb1 ad reorder graph 2023-01-06 17:13:18 +08:00
oahzxl
da4076846d rename 2023-01-06 17:09:37 +08:00
oahzxl
c3d72f7db9 seperate reorder 2023-01-06 16:53:01 +08:00
binmakeswell
a881d6d000 Revert "[NFC] polish code format" (#2372) 2023-01-06 16:01:09 +08:00
Ziyue Jiang
9ae9e74017 fix diff device in some partition 2023-01-06 15:59:06 +08:00
Jiarui Fang
0dcc410f57 [NFC] polish code format 2023-01-06 15:54:06 +08:00
oahzxl
6685a9d022 seperate non chunk input 2023-01-06 15:53:24 +08:00
binmakeswell
d634eae05b Revert "[NFC] polish code format (#2367)" (#2371) 
This reverts commit 1f8ab6f1f5.
 2023-01-06 15:52:16 +08:00
oahzxl
f856611d21 seperate prepose_nodes 2023-01-06 15:47:17 +08:00
Shawn-Kong
d42aecdda1 [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py code style (#2368) 2023-01-06 15:47:10 +08:00
Jiarui Fang
1aaeb596c6 [example] gpt, shard init on all processes (#2366) 2023-01-06 15:44:50 +08:00
oahzxl
f4a1607e56 seperate input node dim search 2023-01-06 15:36:17 +08:00
binmakeswell
1f8ab6f1f5 [NFC] polish code format (#2367) 2023-01-06 15:34:48 +08:00
oahzxl
ae27a8b26d seperate flow tracer 2023-01-06 14:57:33 +08:00