ColossalAI/colossalai/inference/engine
2024-06-14 16:27:46 +08:00
..
modeling [pre-commit.ci] auto fixes from pre-commit.com hooks 2024-06-14 16:27:46 +08:00
policies [shardformer, pipeline] add gradient_checkpointing_ratio and heterogenous shard policy for llama (#5508) 2024-04-01 11:34:58 +08:00
__init__.py [inference] update examples and engine (#5073) 2023-11-20 19:44:52 +08:00
engine.py [inference] refactor examples and fix schedule (#5077) 2023-11-21 10:46:03 +08:00
microbatch_manager.py [hotfix] fix typo change _descrption to _description (#5331) 2024-03-05 21:47:48 +08:00