Hongxin Liu c3b5caff0e [fp8] optimize all-gather (#6043) ...

* [fp8] optimize all-gather

* [fp8] fix all gather fp8 ring

* [fp8] enable compile

* [fp8] fix all gather fp8 ring

2024-09-03 15:45:17 +08:00

..

__init__.py

[Feature] qlora support (#5586)

2024-04-28 10:51:27 +08:00

bnb_config.py

[Feature] qlora support (#5586)

2024-04-28 10:51:27 +08:00

bnb.py

[quant] fix bitsandbytes version check (#5882)

2024-07-04 11:33:23 +08:00

fp8_hook.py

[fp8] support gemini plugin (#5978)

2024-08-09 14:09:48 +08:00

fp8.py

[fp8] optimize all-gather (#6043)

2024-09-03 15:45:17 +08:00

utils.py

[Feature]: support FP8 communication in DDP, FSDP, Gemini (#5928)

2024-08-08 15:55:01 +08:00