26 Commits

Author	SHA1	Message	Date
digger yu	9265f2d4d7	[NFC]fix typo colossalai/auto_parallel nn utils etc. (#3779) ... * fix typo colossalai/autochunk auto_parallel amp * fix typo colossalai/auto_parallel nn utils etc.	2023-05-23 15:28:20 +08:00
Jiarui Fang	21962e1593	[embedding] rename FreqAwareEmbedding -> CachedEmbedding (#1699)	2022-10-13 22:22:27 +08:00
Jiarui Fang	363fc2861a	[embeddings] more detailed timer (#1692)	2022-10-12 12:01:21 +08:00
Jiarui Fang	c638bec028	[embedding] polish async copy (#1657)	2022-09-27 14:37:03 +08:00
Jiarui Fang	988570e4a6	[embedding] add more detail profiling (#1656)	2022-09-27 13:43:59 +08:00
Jiarui Fang	e1f97fd2b8	[embedding] print profiling results (#1654)	2022-09-27 12:50:33 +08:00
Jiarui Fang	04443605a5	[embedding] non-blocking cpu-gpu copy (#1647)	2022-09-26 14:57:57 +08:00
Jiarui Fang	38c68b5b9a	[embedding] rollback for better FAW performance (#1625)	2022-09-22 11:16:25 +08:00
Jiarui Fang	504ff1d101	[embeddings] use cache_ratio instead of cuda_row_num (#1611)	2022-09-20 14:33:04 +08:00
Jiarui Fang	a19eb80998	[embedding] updates some default parameters	2022-09-15 15:45:17 +08:00
CsRic	a389ac4ec9	[embedding] cache_embedding small improvement (#1564)	2022-09-08 16:41:19 +08:00
Jiarui Fang	64169f3e8f	[embedding] polish parallel embedding tablewise (#1545)	2022-09-06 10:41:20 +08:00
Jiarui Fang	4537d39df9	[doc] docstring for FreqAwareEmbeddingBag (#1525)	2022-08-31 13:52:30 +08:00
Jiarui Fang	9a9ef65313	[FAW] cpu caching operations (#1520)	2022-08-30 14:50:02 +08:00
Jiarui Fang	af5438caa2	[FAW] refactor reorder() for CachedParamMgr (#1514)	2022-08-29 14:22:07 +08:00
Jiarui Fang	9feee6d06b	[FAW] LFU initialize with dataset freq (#1513)	2022-08-29 12:52:53 +08:00
CsRic	1b8fee8e9c	[FAW] shrink freq_cnter size (#1509)	2022-08-29 11:44:55 +08:00
Jiarui Fang	ba61109b6c	[FAW] remove code related to chunk (#1501)	2022-08-26 14:23:30 +08:00
Jiarui Fang	d5085bb317	[FAW] add more docs and fix a warning (#1500)	2022-08-26 14:10:21 +08:00
CsRic	0ed2f46131	[FAW] FAW embedding use LRU as eviction strategy intialized with dataset stats (#1494)	2022-08-26 11:24:12 +08:00
CsRic	b8d0e39eaf	[FAW] LFU cache for the FAW	2022-08-25 13:08:46 +08:00
Jiarui Fang	cde7b8a5b8	[FAW] init an LFU implementation for FAW (#1488)	2022-08-24 17:37:22 +08:00
Geng Zhang	0aad53c62b	[FCE] update interface for frequency statistics in FreqCacheEmbedding (#1462)	2022-08-23 17:38:24 +08:00
Jiarui Fang	a1476ea882	[NFC] polish doc style for ColoTensor (#1457)	2022-08-16 09:21:05 +08:00
Geng Zhang	9f3eed66eb	[FAW] reorganize the inheritance struct of FreqCacheEmbedding (#1448)	2022-08-12 15:55:46 +08:00
Jiarui Fang	30b4dd17c0	[FAW] export FAW in _ops (#1438)	2022-08-11 13:43:24 +08:00