FoolPlayer ef1537759c [shardformer] add gpt2 policy and modify shard and slicer to support (#3883) ...

* add gpt2 policy and modify shard and slicer to support

* remove unused code

* polish code

2023-06-08 15:01:34 +08:00

..

_analyzer

[example] add train resnet/vit with booster example (#3694)

2023-05-08 10:42:30 +08:00

_C

[setup] support pre-build and jit-build of cuda kernels (#2374)

2023-01-06 20:50:26 +08:00

amp

[bf16] add bf16 support (#3882)

2023-06-05 15:58:31 +08:00

auto_parallel

[nfc] fix typo colossalai/ applications/ (#3831)

2023-05-25 16:19:41 +08:00

autochunk

fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808)

2023-05-24 09:01:50 +08:00

booster

[doc] fix docs about booster api usage (#3898)

2023-06-06 13:36:11 +08:00

builder

[NFC] polish colossalai/builder/__init__.py code style (#1560)

2022-09-08 22:11:04 +08:00

checkpoint_io

[booster] torch fsdp fix ckpt (#3788)

2023-05-23 16:58:45 +08:00

cli

Modify torch version requirement to adapt torch 2.0 (#3896)

2023-06-05 15:57:35 +08:00

cluster

fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808)

2023-05-24 09:01:50 +08:00

communication

[CI] fix some spelling errors (#3707)

2023-05-10 17:12:03 +08:00

context

[CI] fix some spelling errors (#3707)

2023-05-10 17:12:03 +08:00

device

[dtensor] updated api and doc (#3845)

2023-06-08 10:18:17 +08:00

engine

fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808)

2023-05-24 09:01:50 +08:00

fx

[nfc] fix typo colossalai/cli fx kernel (#3847)

2023-06-02 15:02:45 +08:00

interface

[booster] implemented the torch ddd + resnet example (#3232)

2023-03-27 10:24:14 +08:00

kernel

[bf16] add bf16 support (#3882)

2023-06-05 15:58:31 +08:00

lazy

[dtensor] updated api and doc (#3845)

2023-06-08 10:18:17 +08:00

logging

[logger] hotfix, missing _FORMAT (#2231)

2022-12-29 22:59:39 +08:00

nn

[shardformer] add Dropout layer support different dropout pattern (#3856)

2023-06-08 15:01:34 +08:00

pipeline

[nfc]fix typo colossalai/pipeline tensor nn (#3899)

2023-06-06 14:07:36 +08:00

registry

…

shardformer

[shardformer] add gpt2 policy and modify shard and slicer to support (#3883)

2023-06-08 15:01:34 +08:00

tensor

[dtensor] updated api and doc (#3845)

2023-06-08 10:18:17 +08:00

testing

[NFC] fix typo with colossalai/auto_parallel/tensor_shard (#3742)

2023-05-17 11:13:23 +08:00

trainer

[polish] remove useless file _mem_tracer_hook.py (#1963)

2022-11-16 15:55:10 +08:00

utils

[lazy] refactor lazy init (#3891)

2023-06-05 14:20:47 +08:00

zero

[bf16] add bf16 support (#3882)

2023-06-05 15:58:31 +08:00

__init__.py

[setup] supported conda-installed torch (#2048)

2022-11-30 16:45:15 +08:00

constants.py

updated tp layers

2022-11-02 12:19:38 +08:00

core.py

…

global_variables.py

[NFC] polish colossalai/global_variables.py code style (#3259)

2023-03-29 15:22:21 +08:00

initialize.py

[zero] reorganize zero/gemini folder structure (#3424)

2023-04-04 13:48:16 +08:00