1
0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-05-08 00:18:25 +00:00
ColossalAI/colossalai/zero
Haze188 d9dddf574f
[Gemini] Use async stream to prefetch and h2d data moving ()
* use async stream to prefetch and h2d data moving

* Remove redundant code
2024-06-12 15:48:52 +08:00
..
gemini [Gemini] Use async stream to prefetch and h2d data moving () 2024-06-12 15:48:52 +08:00
low_level [Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor () 2024-05-14 13:52:45 +08:00
__init__.py [shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert () 2023-11-28 16:54:42 +08:00
wrapper.py [misc] update pre-commit and run all files () 2023-09-19 14:20:26 +08:00