3 Commits

Author	SHA1	Message	Date
Insu Jang	00525f7772	[shardformer] fix pipeline forward error if custom layer distribution is used (#5189) ... * Use self.[distribute_layers|get_stage_index] to exploit custom layer distribution * Change static methods for t5 layer distribution to member functions * Change static methods for whisper layer distribution to member functions * Replace whisper policy usage with self one * Fix test case to use non-static layer distribution methods * fix: fix typo --------- Co-authored-by: Wenhao Chen <cwher@outlook.com>	2024-03-27 13:57:00 +08:00
digger yu	71321a07cf	fix typo change dosen't to doesn't (#5308)	2024-01-30 09:57:38 +08:00
Xuanlei Zhao	dc003c304c	[moe] merge moe into main (#4978) ... * update moe module * support openmoe	2023-11-02 02:21:24 +00:00