Hanks 5ce6dd75bf [fp8] disable all_to_all_fp8 in intranode (#6045) ...

* enhance all_to_all_fp8 with internode comm control

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* disable some fp8 ops due to performance issue

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

2024-09-09 13:47:17 +08:00

..

_analyzer

…

_C

…

accelerator

…

amp

…

auto_parallel

[pre-commit.ci] pre-commit autoupdate (#5572)

2024-07-01 17:16:41 +08:00

autochunk

…

booster

[fp8] fix linear hook (#6046)

2024-09-03 16:37:16 +08:00

checkpoint_io

[colossalai/checkpoint_io/...] fix bug in load_state_dict_into_model; format error msg (#6020)

2024-09-02 16:56:35 +08:00

cli

…

cluster

[FP8] rebase main (#5963)

2024-08-06 16:29:37 +08:00

context

…

device

…

fx

…

inference

[colossalai/checkpoint_io/...] fix bug in load_state_dict_into_model; format error msg (#6020)

2024-09-02 16:56:35 +08:00

interface

…

kernel

…

lazy

[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016)

2024-08-22 09:21:34 +08:00

legacy

[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016)

2024-08-22 09:21:34 +08:00

logging

[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016)

2024-08-22 09:21:34 +08:00

moe

[fp8]Moe support fp8 communication (#5977)

2024-08-09 18:26:02 +08:00

nn

…

pipeline

[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016)

2024-08-22 09:21:34 +08:00

quantization

[fp8] disable all_to_all_fp8 in intranode (#6045)

2024-09-09 13:47:17 +08:00

shardformer

Merge pull request #6012 from hpcaitech/feature/fp8_comm

2024-08-27 10:09:43 +08:00

tensor

[fp8] support fp8 amp for hybrid parallel plugin (#5975)

2024-08-07 18:21:08 +08:00

testing

[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016)

2024-08-22 09:21:34 +08:00

utils

…

zero

[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016)

2024-08-22 09:21:34 +08:00

__init__.py

…

initialize.py

[FP8] rebase main (#5963)

2024-08-06 16:29:37 +08:00