github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-06-26 15:32:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fixed a typo

Browse Source
This commit is contained in:
yuehuayingxueluo 2024-01-04 15:09:06 +08:00 committed by FrankLeeeee
parent bbfebfb9fc
commit b2eb9cd186
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/inference/modeling/models/llama.py
View File

@ -159,7 +159,7 @@ def llama_attn_forward(
_, _, _, block_size = k_cache.shape
# NOTE: context_attention_unpadded is unsed for testing accuracy and we can only use aligned inputs.
# NOTE: context_attention_unpadded is used for testing accuracy and we can only use aligned inputs.
# The code below will be uncommented after the development of attention-related kernel is completed.
if is_prompts:
attn_output = context_attention_unpadded(