Hongxin Liu 508ca36fe3 [pipeline] 1f1b schedule receive microbatch size (#4589)

2023-09-01 21:45:14 +08:00

..

_analyzer

…

_C

…

amp

[pipeline] support fp32 for HybridPlugin/merge shardformer test and pipeline test into one file (#4354)

2023-08-15 23:25:14 +08:00

auto_parallel

[NFC] polish runtime_preparation_pass style (#4266)

2023-07-26 14:12:57 +08:00

autochunk

…

booster

[pipeline] 1f1b schedule receive microbatch size (#4589)

2023-09-01 21:45:14 +08:00

builder

…

checkpoint_io

[shardformer] support from_pretrained when loading model with HybridParallelPlugin (#4575)

2023-09-01 17:40:01 +08:00

cli

fix localhost measurement (#4320)

2023-08-01 10:14:00 +08:00

cluster

[shardformer] support interleaved pipeline (#4448)

2023-08-16 19:29:03 +08:00

communication

[NFC] fix: format (#4270)

2023-07-26 14:12:57 +08:00

context

…

device

[format] applied code formatting on changed files in pull request 4152 (#4157)

2023-07-04 16:07:47 +08:00

engine

[nfc]fix ColossalaiOptimizer is not defined (#4122)

2023-06-30 17:23:22 +08:00

fx

…

interface

[pipeline] refactor 1f1b schedule (#4115)

2023-08-15 23:25:14 +08:00

kernel

[shardformer] update shardformer to use flash attention 2 (#4392)

2023-08-15 23:25:14 +08:00

lazy

[shardformer] support lazy init (#4202)

2023-08-15 23:25:14 +08:00

logging

…

nn

[doc] add Series A Funding and NeurIPS news (#4377)

2023-08-04 17:42:07 +08:00

pipeline

[pipeline] 1f1b schedule receive microbatch size (#4589)

2023-09-01 21:45:14 +08:00

registry

…

shardformer

[shardformer] fix submodule replacement bug when enabling pp (#4544)

2023-08-31 09:57:18 +08:00

tensor

[pipeline] support fp32 for HybridPlugin/merge shardformer test and pipeline test into one file (#4354)

2023-08-15 23:25:14 +08:00

testing

Next commit [checkpointio] Unsharded Optimizer Checkpoint for Gemini Plugin (#4141)

2023-07-07 16:33:06 +08:00

trainer

…

utils

[test] remove useless tests (#4359)

2023-08-01 18:52:14 +08:00

zero

[shardformer] support sharded optimizer checkpointIO of HybridParallelPlugin (#4540)

2023-08-31 14:50:47 +08:00

__init__.py

…

constants.py

…

core.py

…

global_variables.py

…

initialize.py

…