Yuanheng Zhao e2c0e7f92a [hotfix] Fix import error: colossal.kernel without triton installed (#4722) ...

* [hotfix] remove triton kernels from kernel init

* revise bloom/llama kernel imports for infer

2023-09-14 18:03:55 +08:00

..

modeling

[hotfix] Fix import error: colossal.kernel without triton installed (#4722)

2023-09-14 18:03:55 +08:00

policies

[hotfix] Fix import error: colossal.kernel without triton installed (#4722)

2023-09-14 18:03:55 +08:00

__init__.py

[Feature] The first PR to Add TP inference engine, kv-cache manager and related kernels for our inference system (#4577)

2023-09-12 01:22:56 +08:00

batch_infer_state.py

[Feature] The first PR to Add TP inference engine, kv-cache manager and related kernels for our inference system (#4577)

2023-09-12 01:22:56 +08:00

engine.py

[Feature] The first PR to Add TP inference engine, kv-cache manager and related kernels for our inference system (#4577)

2023-09-12 01:22:56 +08:00

kvcache_manager.py

[Feature] The first PR to Add TP inference engine, kv-cache manager and related kernels for our inference system (#4577)

2023-09-12 01:22:56 +08:00