Runyu Lu 3c7cda0c9a [Inference]Lazy Init Support (#5785) ...

* lazy init support

* lazy init llama support

* :lazy init support for baichuan

* aligh rpc

* add note for baichuan

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

2024-06-27 18:02:15 +08:00

..

__init__.py

[Hotfix] Add missing init file in inference.executor (#5774)

2024-06-03 22:29:39 +08:00

rpc_worker.py

[Inference]Lazy Init Support (#5785)

2024-06-27 18:02:15 +08:00