github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-08-11 21:01:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
dev/zero-offload
ColossalAI/colossalai/legacy/inference/tensor_parallel
History
pre-commit-ci[bot] df612434c9 [pre-commit.ci] auto fixes from pre-commit.com hooks 
for more information, see https://pre-commit.ci
2024-06-14 16:27:46 +08:00
..
modeling [pre-commit.ci] auto fixes from pre-commit.com hooks 2024-06-14 16:27:46 +08:00
policies [inference] Refactor inference architecture (#5057) 2023-11-19 21:05:05 +08:00
__init__.py [inference] Refactor inference architecture (#5057) 2023-11-19 21:05:05 +08:00
batch_infer_state.py [inference] Refactor inference architecture (#5057) 2023-11-19 21:05:05 +08:00
engine.py [inference] Refactor inference architecture (#5057) 2023-11-19 21:05:05 +08:00
kvcache_manager.py [inference] Refactor inference architecture (#5057) 2023-11-19 21:05:05 +08:00