11 Commits

Author	SHA1	Message	Date
flybird1111	458ae331ad	[kernel] updated unittests for coloattention (#4389) ... Updated coloattention tests of checking outputs and gradients	2023-08-09 14:24:45 +08:00
flybird1111	38b792aab2	[coloattention] fix import error (#4380) ... fixed an import error	2023-08-04 16:28:41 +08:00
flybird1111	25c57b9fb4	[fix] coloattention support flash attention 2 (#4347) ... Improved ColoAttention interface to support flash attention 2. Solved #4322	2023-08-04 13:46:22 +08:00
Frank Lee	80eba05b0a	[test] refactor tests with spawn (#3452) ... * [test] added spawn decorator * polish code * polish code * polish code * polish code * polish code * polish code	2023-04-06 14:51:35 +08:00
zbian	7bc0afc901	updated flash attention usage	2023-03-20 17:57:04 +08:00
アマデウス	077a66dd81	updated attention kernel (#2133)	2022-12-16 10:54:03 +08:00
zbian	6877121377	updated flash attention api	2022-11-15 15:25:39 +08:00
oahzxl	9639ea88fc	[kernel] more flexible flashatt interface (#1804)	2022-11-07 17:02:09 +08:00
oahzxl	501a9e9cd2	[hotfix] polish flash attention (#1802)	2022-11-07 14:30:22 +08:00
Jiarui Fang	c248800359	[kernel] skip tests of flash_attn and triton when they are not available (#1798)	2022-11-07 13:41:13 +08:00
oahzxl	25952b67d7	[feat] add flash attention (#1762)	2022-10-26 16:15:52 +08:00