Xu Kai 20332a7a34 [inference] udpate example (#5053) ... * udpate example * fix run.sh		2023-11-16 11:07:43 +08:00
..
modeling	[Refactor] remove useless inference code (#5022)	2023-11-10 14:47:06 +08:00
polices	[Refactor] refactor policy search and quant type controlling in inference (#5035)	2023-11-14 17:26:59 +08:00
__init__.py	[Pipeline Inference] Merge pp with tp (#4993)	2023-11-01 12:46:21 +08:00
engine.py	[inference] udpate example (#5053)	2023-11-16 11:07:43 +08:00
microbatch_manager.py	[Refactor] remove useless inference code (#5022)	2023-11-10 14:47:06 +08:00