ColossalAI/examples/language/llama2/attn.py at 5be590b99eb6c58c3aa809d453680139fdd2b9f7 - ColossalAI - Gitea: Git with a cup of tea at home

github/ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-05-04 01:48:43 +00:00

Files

Hongxin Liu d882d18c65 [example] reuse flash attn patch (#5400 )

2024-02-27 11:22:07 +08:00

Symbolic link

1 line

85 B

Python

Raw Blame History

../../../applications/Colossal-LLaMA-2/colossal_llama2/utils/flash_attention_patch.py