mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-06-18 19:58:17 +00:00
3a74eb4b3a
* add Colossal-Inference serving example w/ TorchServe * add dockerfile * fix dockerfile * fix dockerfile: fix commit hash, install curl * refactor file structure * revise readme * trivial * trivial: dockerfile format * clean dir; revise readme * fix comments: fix imports and configs * fix formats * remove unused requirements
11 lines
286 B
INI
11 lines
286 B
INI
inference_address=http://0.0.0.0:8084
|
|
management_address=http://0.0.0.0:8085
|
|
metrics_address=http://0.0.0.0:8086
|
|
enable_envvars_config=true
|
|
install_py_dep_per_model=true
|
|
number_of_gpu=1
|
|
load_models=all
|
|
max_response_size=655350000
|
|
default_response_timeout=6000
|
|
model_store=./model_store
|