Michael Goin 621da3c164 Adds DeepSparse as an LLM (#9184) ...

Adds [DeepSparse](https://github.com/neuralmagic/deepsparse) as an LLM
backend. DeepSparse supports running various open-source sparsified
models hosted on [SparseZoo](https://sparsezoo.neuralmagic.com/) for
performance gains on CPUs.

Twitter handles: @mgoin_ @neuralmagic


---------

Co-authored-by: Bagatur <baskaryan@gmail.com>

2023-08-13 22:35:58 -07:00

2.3 KiB

Raw Permalink Blame History

View Raw