github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-09 13:00:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

[doc] updated inference readme (#5343)

Browse Source
This commit is contained in:
Frank Lee
2024-02-02 14:31:10 +08:00
committed by GitHub
parent e76acbb076
commit 027aa1043f
10 changed files with 82 additions and 33 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/inference/core/request_handler.py
View File

@@ -11,6 +11,8 @@ from colossalai.inference.sampler import *
from colossalai.inference.struct import BatchInfo, RequestStatus, Sequence
from colossalai.logging import get_dist_logger
__all__ = ["RunningList", "RequestHandler"]
logger = get_dist_logger(__name__)