Frank Lee 39163417a1 [example] updated the hybrid parallel tutorial (#2444) ...

* [example] updated the hybrid parallel tutorial

* polish code

2023-01-11 15:17:17 +08:00

..

_C

[setup] support pre-build and jit-build of cuda kernels (#2374)

2023-01-06 20:50:26 +08:00

amp

[setup] support pre-build and jit-build of cuda kernels (#2374)

2023-01-06 20:50:26 +08:00

auto_parallel

[autoparallel] integrate device mesh initialization into autoparallelize (#2393)

2023-01-11 14:03:49 +08:00

autochunk

adapt new fx

2023-01-10 11:56:00 +08:00

builder

…

cli

[example] updated the hybrid parallel tutorial (#2444)

2023-01-11 15:17:17 +08:00

communication

[NFC] polish communication/p2p_v2.py code style (#2303)

2023-01-04 15:09:57 +08:00

context

Update parallel_context.py (#2408)

2023-01-10 11:27:23 +08:00

device

[autoparallel] integrate device mesh initialization into autoparallelize (#2393)

2023-01-11 14:03:49 +08:00

engine

…

fx

[fx] allow native ckpt trace and codegen. (#2438)

2023-01-11 13:49:59 +08:00

gemini

[ddp] add is_ddp_ignored (#2434)

2023-01-11 12:22:45 +08:00

kernel

[hotfix] issue #2388

2023-01-07 18:23:02 +08:00

logging

[logger] hotfix, missing _FORMAT (#2231)

2022-12-29 22:59:39 +08:00

nn

[zero] fix state_dict and load_state_dict for ddp ignored parameters (#2443)

2023-01-11 14:55:41 +08:00

pipeline

fix diff device in some partition

2023-01-06 15:59:06 +08:00

registry

…

tensor

[hotfix] fix implement error in diffusers

2023-01-07 07:56:39 +08:00

testing

[amp] add gradient clipping for unit tests (#2283)

2023-01-04 11:59:56 +08:00

trainer

[polish] remove useless file _mem_tracer_hook.py (#1963)

2022-11-16 15:55:10 +08:00

utils

[ddp] add is_ddp_ignored (#2434)

2023-01-11 12:22:45 +08:00

zero

[ddp] add is_ddp_ignored (#2434)

2023-01-11 12:22:45 +08:00

__init__.py

[setup] supported conda-installed torch (#2048)

2022-11-30 16:45:15 +08:00

constants.py

updated tp layers

2022-11-02 12:19:38 +08:00

core.py

…

global_variables.py

updated tp layers

2022-11-02 12:19:38 +08:00

initialize.py

…