github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-13 21:22:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,189 Commits 59 Branches 51 Tags
feat/speculative-decoding
Commit Graph

1867 Commits

Author SHA1 Message Date
oahzxl
212b5b1b5f add comments 2023-01-09 16:29:33 +08:00
oahzxl
19cc64b1d3 remove autochunk_available 2023-01-09 16:06:58 +08:00
eric8607242
9880fd2cd8 Fix state_dict key missing issue of the ZeroDDP (#2363) 
* Fix state_dict output for ZeroDDP duplicated parameters

* Rewrite state_dict based on get_static_torch_model

* Modify get_static_torch_model to be compatible with the lower version (ZeroDDP)
 2023-01-09 14:35:14 +08:00
oahzxl
4d223e18a2 fix typo 2023-01-09 13:46:17 +08:00
Frank Lee
ce08661eb1 [cli] updated installation check cli for aot/jit build (#2395) 2023-01-09 11:05:27 +08:00
jiaruifang
69d9180c4b [hotfix] issue #2388 2023-01-07 18:23:02 +08:00
Jiarui Fang
4e96039649 [device] find best logical mesh 2023-01-07 14:04:30 +08:00
Jiarui Fang
8f72b6f8fb [hotfix] fix implement error in diffusers 2023-01-07 07:56:39 +08:00
Frank Lee
40d376c566 [setup] support pre-build and jit-build of cuda kernels (#2374) 
* [setup] support pre-build and jit-build of cuda kernels

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
 2023-01-06 20:50:26 +08:00
1SAA
33f3023e19 [hotfix] fix implement error in diffusers 2023-01-06 18:37:18 +08:00
Jiarui Fang
12c8bf38d7 [Pipeline] Refine GPT PP Example 2023-01-06 18:03:45 +08:00
oahzxl
8a989a0d89 code style 2023-01-06 17:55:22 +08:00
oahzxl
c3a2bf48b4 code style 2023-01-06 17:31:59 +08:00
oahzxl
a6cdbf9161 seperate trace flow 2023-01-06 17:24:23 +08:00
oahzxl
4748967fb1 ad reorder graph 2023-01-06 17:13:18 +08:00
oahzxl
da4076846d rename 2023-01-06 17:09:37 +08:00
oahzxl
c3d72f7db9 seperate reorder 2023-01-06 16:53:01 +08:00
binmakeswell
a881d6d000 Revert "[NFC] polish code format" (#2372) 2023-01-06 16:01:09 +08:00
Ziyue Jiang
9ae9e74017 fix diff device in some partition 2023-01-06 15:59:06 +08:00
Jiarui Fang
0dcc410f57 [NFC] polish code format 2023-01-06 15:54:06 +08:00
oahzxl
6685a9d022 seperate non chunk input 2023-01-06 15:53:24 +08:00
binmakeswell
d634eae05b Revert "[NFC] polish code format (#2367)" (#2371) 
This reverts commit 1f8ab6f1f5.
 2023-01-06 15:52:16 +08:00
oahzxl
f856611d21 seperate prepose_nodes 2023-01-06 15:47:17 +08:00
Shawn-Kong
d42aecdda1 [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/embedding_handler.py code style (#2368) 2023-01-06 15:47:10 +08:00
Jiarui Fang
1aaeb596c6 [example] gpt, shard init on all processes (#2366) 2023-01-06 15:44:50 +08:00
oahzxl
f4a1607e56 seperate input node dim search 2023-01-06 15:36:17 +08:00
binmakeswell
1f8ab6f1f5 [NFC] polish code format (#2367) 2023-01-06 15:34:48 +08:00
oahzxl
ae27a8b26d seperate flow tracer 2023-01-06 14:57:33 +08:00
oahzxl
fd87d78a28 rename ambiguous variable 2023-01-06 14:28:04 +08:00
oahzxl
2bde9d2b7f code format 2023-01-06 14:21:49 +08:00
oahzxl
8a634af2f5 close mem and code print 2023-01-06 14:19:45 +08:00
oahzxl
1a6d2a740b take apart chunk code gen 2023-01-06 14:14:45 +08:00
ExtremeViscent
ac0d30fe2e [NFC] polish batch_norm_handler.py code style (#2359) 2023-01-06 13:41:38 +08:00
HELSON
48d33b1b17 [gemini] add get static torch model (#2356) 2023-01-06 13:41:19 +08:00
oahzxl
efb1c64c30 restruct dir 2023-01-06 11:39:26 +08:00
ziyuhuang123
7080a8edb0 [workflow]New version: Create workflow files for examples' auto check (#2298) 
* [workflows]bug_repair

* [workflow]new_pr_fixing_bugs

Co-authored-by: binmakeswell <binmakeswell@gmail.com>
 2023-01-06 09:26:49 +08:00
LuGY
e11a005c02 [NFC] polish colossalai/auto_parallel/tensor_shard/utils/factory.py code style (#2349) 2023-01-05 21:17:42 +08:00
YuliangLiu0306
b5a3a4a65f [device] find best logical mesh 2023-01-05 17:21:29 +08:00
yuxuan-lou
28e2d16794 [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/graph_analysis.py code style (#2340) 2023-01-05 16:53:24 +08:00
YuliangLiu0306
9c9246c0d9 [device] alpha beta profiler (#2311) 
* [device] alpha beta profiler

* add usage

* fix variable name
 2023-01-05 16:39:55 +08:00
Maruyama_Aya
bd12a49e2a [NFC] polish <colossalai/auto_parallel/tensor_shard/deprecated/constants.py> code style (#2339) 2023-01-05 16:20:54 +08:00
Zihao
35427bcab4 [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/unary_elementwise_handler.py code style (#2326) 2023-01-05 12:18:08 +08:00
Jiarui Fang
db6eea3583 [builder] reconfig op_builder for pypi install (#2314) 2023-01-04 16:32:32 +08:00
Junming Wu
4a79c10750 [NFC] polish colossalai/cli/benchmark/__init__.py code style (#2308) 2023-01-04 15:09:57 +08:00
Ofey Chan
87d2defda6 [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/layer_norm_handler.py code style (#2305) 2023-01-04 15:09:57 +08:00
ver217
116e3d0b8f [NFC] polish communication/p2p_v2.py code style (#2303) 2023-01-04 15:09:57 +08:00
xyupeng
b965585d05 [NFC] polish colossalai/amp/torch_amp/torch_amp.py code style (#2290) 2023-01-04 15:09:57 +08:00
Zangwei Zheng
d1e5bafcd4 [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/__init__.py code style (#2291) 2023-01-04 15:09:57 +08:00
shenggan
950685873f [NFC] polish colossalai/auto_parallel/tensor_shard/deprecated/op_handler/reshape_handler.py code style (#2292) 2023-01-04 15:09:57 +08:00
Ziheng Qin
3041014089 [NFC] polish colossalai/amp/naive_amp/grad_scaler/dynamic_grad_scaler.py code style (#2299) 
Co-authored-by: henryqin1997 <henryqin1997@gamil.com>
 2023-01-04 15:09:57 +08:00