This website requires JavaScript.
Explore
Help
Register
Sign In
github
/
ColossalAI
Watch
1
Star
0
Fork
0
You've already forked ColossalAI
mirror of
https://github.com/hpcaitech/ColossalAI.git
synced
2026-04-12 15:14:55 +00:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
Files
12e7c28d5e8f219480d1dbc682fd225dc76fcc2b
ColossalAI
/
colossalai
/
inference
/
kv_cache
History
Yuanheng Zhao
f9afe0addd
[hotfix] Fix KV Heads Number Assignment in KVCacheManager (
#5695
)
...
- Fix key value number assignment in KVCacheManager, as well as method of accessing
2024-05-07 23:13:14 +08:00
..
__init__.py
[Inference] Add CacheBlock and KV-Cache Manager (
#5156
)
2024-01-11 13:39:29 +00:00
block_cache.py
[doc] updated inference readme (
#5343
)
2024-02-02 14:31:10 +08:00
kvcache_manager.py
[hotfix] Fix KV Heads Number Assignment in KVCacheManager (
#5695
)
2024-05-07 23:13:14 +08:00