github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-05-10 01:17:45 +00:00
Code Issues Packages Projects Releases Wiki Activity
827ef3ee9a
ColossalAI/colossalai/shardformer/layer
History
wangbluo 827ef3ee9a fix
2024-09-14 10:40:35 +00:00
..
__init__.py [fp8] Merge feature/fp8_comm to main branch of Colossalai () 2024-08-22 09:21:34 +08:00
_operation.py [Feature] Split cross-entropy computation in SP () 2024-09-10 12:06:50 +08:00
attn.py fix 2024-09-14 10:40:35 +00:00
dropout.py [misc] update pre-commit and run all files () 2023-09-19 14:20:26 +08:00
embedding.py [fp8] support hybrid parallel plugin () 2024-08-12 18:17:05 +08:00
linear.py [fp8] Merge feature/fp8_comm to main branch of Colossalai () 2024-08-22 09:21:34 +08:00
loss.py [Feature] Split cross-entropy computation in SP () 2024-09-10 12:06:50 +08:00
normalization.py [fp8] Merge feature/fp8_comm to main branch of Colossalai () 2024-08-22 09:21:34 +08:00
parallel_module.py [shardformer] refactor embedding resize () 2024-04-18 16:10:18 +08:00
qkv_fused_linear.py [Feature] Split cross-entropy computation in SP () 2024-09-10 12:06:50 +08:00
utils.py [Feature] Split cross-entropy computation in SP () 2024-09-10 12:06:50 +08:00