1
0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-05-07 07:58:27 +00:00
ColossalAI/colossalai/zero
Guangyao Zhang f20b066c59
[fp8] Disable all_gather intranode. Disable Redundant all_gather fp8 ()
* all_gather only internode, fix pytest

* fix cuda arch <89 compile pytest error

* fix pytest failure

* disable all_gather_into_tensor_flat_fp8

* fix fp8 format

* fix pytest

* fix conversations

* fix chunk tuple to list
2024-09-14 10:40:01 +08:00
..
gemini [fp8] Disable all_gather intranode. Disable Redundant all_gather fp8 () 2024-09-14 10:40:01 +08:00
low_level [fp8] Disable all_gather intranode. Disable Redundant all_gather fp8 () 2024-09-14 10:40:01 +08:00
__init__.py [shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert () 2023-11-28 16:54:42 +08:00
wrapper.py [misc] update pre-commit and run all files () 2023-09-19 14:20:26 +08:00