Runyu Lu e37ee2fb65 [Feat]Tensor Model Parallel Support For Inference (#5563) ...

* tensor parallel support naive source

* [fix]precision, model load and refactor the framework

* add tp unit test

* docstring

* fix do_sample

2024-04-18 16:56:46 +08:00

5.4 KiB

Raw Blame History

View Raw