mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-05-24 16:13:56 +00:00
600881a8ea
* add cuda KVCache kernel * annotation benchmark_kvcache_copy * add use cuda * fix import path * move benchmark scripts to example/ * rm benchmark codes in test_kv_cache_memcpy.py * rm redundancy codes * rm redundancy codes * pr was modified according to the review
4 lines
99 B
Python
4 lines
99 B
Python
from .inference_ops_cuda import InferenceOpsCudaExtension
|
|
|
|
__all__ = ["InferenceOpsCudaExtension"]
|