ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-28 21:17:08 +00:00

Files

Hongxin Liu d921ce8391 [shardformer] support inplace sharding (#4251 )

* [shardformer] embedding support inplace sharding

* [shardformer] linear support inplace sharding

* [shardformer] layernorm support inplace sharding

* [shardformer] qkv support inplace sharding

* [test] update shardformer layer test

* [shardformer] fix shared param sharding

* [shardformer] fix bert policy

* [shardformer] fix bloom policy

* [shardformer] fix llama policy

* [shardformer] fix opt policy

* [shardformer] fix t5 policy

* [shardformer] fix fused qkv linear

* [shardformer] fix bugs

* force sync

* [test] fix bugs

* [test] fix transformer version

2023-08-15 23:25:14 +08:00

d_tensor

[shardformer] support inplace sharding (#4251 )

2023-08-15 23:25:14 +08:00

__init__.py

[Gemini] ParamOpHook -> ColoParamOpHook (#2080 )

2022-12-05 17:11:06 +08:00

colo_parameter.py

[polish] polish ColoTensor and its submodules (#2537 )

2023-02-03 11:44:10 +08:00

colo_tensor.py

[doc] Fix typo under colossalai and doc(#3618 )