Baizhou Zhang f911d5b09d [doc] Add user document for Shardformer (#4702) ...

* create shardformer doc files

* add docstring for seq-parallel

* update ShardConfig docstring

* add links to llama example

* add outdated massage

* finish introduction & supporting information

* finish 'how shardformer works'

* finish shardformer.md English doc

* fix doctest fail

* add Chinese document

2023-09-15 10:56:39 +08:00

..

_analyzer

[example] add train resnet/vit with booster example (#3694)

2023-05-08 10:42:30 +08:00

_C

[setup] support pre-build and jit-build of cuda kernels (#2374)

2023-01-06 20:50:26 +08:00

amp

[pipeline] support fp32 for HybridPlugin/merge shardformer test and pipeline test into one file (#4354)

2023-08-15 23:25:14 +08:00

auto_parallel

[legacy] move communication and nn to legacy and refactor logger (#4671)

2023-09-11 16:24:28 +08:00

autochunk

fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808)

2023-05-24 09:01:50 +08:00

booster

[doc] Add user document for Shardformer (#4702)

2023-09-15 10:56:39 +08:00

checkpoint_io

[hotfix] fix typo in hybrid parallel io (#4697)

2023-09-12 17:32:19 +08:00

cli

[legacy] move communication and nn to legacy and refactor logger (#4671)

2023-09-11 16:24:28 +08:00

cluster

[shardformer] support interleaved pipeline (#4448)

2023-08-16 19:29:03 +08:00

context

[legacy] move builder and registry to legacy (#4603)

2023-09-05 21:53:10 +08:00

device

fix some typo with colossalai/device colossalai/tensor/ etc. (#4171)

2023-09-12 17:41:52 +08:00

fx

[nfc] fix typo colossalai/cli fx kernel (#3847)

2023-06-02 15:02:45 +08:00

inference

[hotfix] Fix import error: colossal.kernel without triton installed (#4722)

2023-09-14 18:03:55 +08:00

interface

[zero] hotfix master param sync (#4618)

2023-09-05 15:04:02 +08:00

kernel

[hotfix] Fix import error: colossal.kernel without triton installed (#4722)

2023-09-14 18:03:55 +08:00

lazy

[shardformer] support lazy init (#4202)

2023-08-15 23:25:14 +08:00

legacy

[legacy] move communication and nn to legacy and refactor logger (#4671)

2023-09-11 16:24:28 +08:00

logging

[legacy] move communication and nn to legacy and refactor logger (#4671)

2023-09-11 16:24:28 +08:00

nn

[legacy] move communication and nn to legacy and refactor logger (#4671)

2023-09-11 16:24:28 +08:00

pipeline

[legacy] move communication and nn to legacy and refactor logger (#4671)

2023-09-11 16:24:28 +08:00

shardformer

[doc] Add user document for Shardformer (#4702)

2023-09-15 10:56:39 +08:00

tensor

fix some typo with colossalai/device colossalai/tensor/ etc. (#4171)

2023-09-12 17:41:52 +08:00

testing

Next commit [checkpointio] Unsharded Optimizer Checkpoint for Gemini Plugin (#4141)

2023-07-07 16:33:06 +08:00

utils

[legacy] move communication and nn to legacy and refactor logger (#4671)

2023-09-11 16:24:28 +08:00

zero

[legacy] move communication and nn to legacy and refactor logger (#4671)

2023-09-11 16:24:28 +08:00

__init__.py

[setup] supported conda-installed torch (#2048)

2022-11-30 16:45:15 +08:00

constants.py

updated tp layers

2022-11-02 12:19:38 +08:00

core.py

[Tensor] distributed view supports inter-process hybrid parallel (#1169)

2022-06-27 09:45:26 +08:00

global_variables.py

[NFC] polish colossalai/global_variables.py code style (#3259)

2023-03-29 15:22:21 +08:00

initialize.py

[legacy] move builder and registry to legacy (#4603)

2023-09-05 21:53:10 +08:00