Wang Binluo b2483c8e31 [fp8] support hybrid parallel plugin (#5982) ...

* support fp8 comm for qwen2 model

* support fp8 comm for qwen2 model

* support fp8 comm for qwen2 model

* fp8

* fix

* bert and bloom

* chatglm and command

* gpt2,gptj,bert, falcon,blip2

* mistral,opy,sam,t5,vit,whisper

* fix

* fix

* fix

2024-08-12 18:17:05 +08:00

16 KiB

Raw Blame History

View Raw