github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-11 22:10:37 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Fix/Infer] Remove unused deps and revise requirements (#5341)

Browse Source 
* remove flash-attn dep

* rm padding llama

* revise infer requirements

* move requirements out of module
This commit is contained in:
Yuanheng Zhao
2024-02-06 17:27:45 +08:00
committed by GitHub
parent 631862f339
commit 1dedb57747
5 changed files with 2 additions and 551 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
colossalai/inference/modeling/policy/__init__.py
View File

@@ -1,9 +1,7 @@
from .nopadding_llama import NoPaddingLlamaModelInferPolicy
from .padding_llama import PaddingLlamaModelInferPolicy
model_policy_map = {
"padding_llama": PaddingLlamaModelInferPolicy,
"nopadding_llama": NoPaddingLlamaModelInferPolicy,
}
__all__ = ["PaddingLlamaModelInferPolicy", "NoPaddingLlamaModelInferPolicy", "model_polic_map"]
__all__ = ["NoPaddingLlamaModelInferPolicy", "model_polic_map"]