mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-08-27 20:22:09 +00:00
* refactor pipeline into new CaiInferEngine * updata llama modeling forward * merge tp with pp * update docstring * optimize test workflow and example * fix typo * add assert and todo |
||
---|---|---|
.. | ||
test_dynamic_batching | ||
_utils.py | ||
test_bloom_infer.py | ||
test_chatglm2_infer.py | ||
test_infer_engine.py | ||
test_kvcache_manager.py | ||
test_llama2_infer.py | ||
test_llama_infer.py | ||
test_pipeline_infer.py |