mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-05-01 21:26:42 +00:00
d85d91435a
* add glide-llama policy and modeling * update glide modeling, compitable with transformers 4.36.2 * revise glide llama modeling/usage * fix issues of glimpsing large kv * revise the way re-loading params for glide drafter * fix drafter and engine tests * enable convert to glide strict=False * revise glide llama modeling * revise vicuna prompt template * revise drafter and tests * apply usage of glide model in engine
5 lines
129 B
Python
5 lines
129 B
Python
from .drafter import Drafter
|
|
from .struct import DrafterOutput, GlideInput
|
|
|
|
__all__ = ["Drafter", "DrafterOutput", "GlideInput"]
|