ColossalAI/colossalai/inference/quant/__init__.py
Xu Kai 450115bd0f [refactor] refactor gptq and smoothquant llama (#5012)
* refactor gptq and smoothquant llama

* fix import error

* fix linear import torch-int

* fix smoothquant llama import error

* fix import accelerate error

* fix bug

* fix import smooth cuda

* fix smoothcuda
2023-11-09 10:12:11 +08:00

2 lines
61 B
Python

from .smoothquant.models.llama import SmoothLlamaForCausalLM