github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-07 03:52:01 +00:00
Code Issues Packages Projects Releases Wiki Activity

[inference] moved ops tests to test_infer (#5354)

Browse Source
This commit is contained in:
Frank Lee
2024-02-02 13:51:22 +08:00
committed by GitHub
parent db1a763307
commit e76acbb076
9 changed files with 7 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
tests/test_infer/test_config_and_struct.py
View File

@@ -63,6 +63,9 @@ def check_config_and_inference():
batch.add_seqs([sequence])
batch.add_seqs([sequence2, sequence3])
# add duplicated sequence to test that it will not be counted twice
batch.add_seqs([sequence])
assert batch.is_empty == False
assert batch.get_batch_size() == 3
batch.update_batch_tokens([1, 2, 3])