Hongxin Liu ccabcf6485 [fp8] support fp8 amp for hybrid parallel plugin (#5975) ...

* [fp8] support fp8 amp for hybrid parallel plugin

* [test] add fp8 hook test

* [fp8] fix fp8 linear compatibility

2024-08-07 18:21:08 +08:00

..

d_tensor

[FP8] rebase main (#5963)

2024-08-06 16:29:37 +08:00

moe_tensor

[MoE/ZeRO] Moe refactor with zero refactor (#5821)

2024-06-28 14:00:08 +08:00

padded_tensor

[shardformer] refactor embedding resize (#5603)

2024-04-18 16:10:18 +08:00

__init__.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

colo_parameter.py

[fp8] support fp8 amp for hybrid parallel plugin (#5975)

2024-08-07 18:21:08 +08:00

colo_tensor.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

comm_spec.py

fix some typo (#5307)

2024-01-25 13:56:27 +08:00

param_op_hook.py

[fp8] support fp8 amp for hybrid parallel plugin (#5975)

2024-08-07 18:21:08 +08:00

shape_consistency.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

sharding_spec.py

[FP8] rebase main (#5963)

2024-08-06 16:29:37 +08:00

utils.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00