mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2026-01-13 19:46:01 +00:00
d921ce8391
* [shardformer] embedding support inplace sharding * [shardformer] linear support inplace sharding * [shardformer] layernorm support inplace sharding * [shardformer] qkv support inplace sharding * [test] update shardformer layer test * [shardformer] fix shared param sharding * [shardformer] fix bert policy * [shardformer] fix bloom policy * [shardformer] fix llama policy * [shardformer] fix opt policy * [shardformer] fix t5 policy * [shardformer] fix fused qkv linear * [shardformer] fix bugs * force sync * [test] fix bugs * [test] fix transformer version
21 lines
543 B
Plaintext
21 lines
543 B
Plaintext
diffusers
|
|
fbgemm-gpu==0.2.0
|
|
pytest
|
|
coverage==7.2.3
|
|
git+https://github.com/hpcaitech/pytest-testmon
|
|
torchvision
|
|
transformers==4.30.2
|
|
timm
|
|
titans
|
|
torchaudio
|
|
torchx-nightly==2022.6.29 # torchrec 0.2.0 requires torchx-nightly. This package is updated every day. We fix the version to a specific date to avoid breaking changes.
|
|
torchrec==0.2.0
|
|
contexttimer
|
|
einops
|
|
triton==2.0.0.dev20221202
|
|
requests==2.27.1 # downgrade to avoid huggingface error https://github.com/huggingface/transformers/issues/17611
|
|
SentencePiece
|
|
ninja
|
|
flash_attn>=2.0
|
|
datasets
|