2 Commits

Author	SHA1	Message	Date
Hongxin Liu	8241c0c054	[fp8] support gemini plugin (#5978) ... * [fp8] refactor hook * [fp8] support gemini plugin * [example] add fp8 option for llama benchmark	2024-08-09 14:09:48 +08:00
Hongxin Liu	ccabcf6485	[fp8] support fp8 amp for hybrid parallel plugin (#5975) ... * [fp8] support fp8 amp for hybrid parallel plugin * [test] add fp8 hook test * [fp8] fix fp8 linear compatibility	2024-08-07 18:21:08 +08:00