2 Commits

Author	SHA1	Message	Date
linsj20	52a2dded36	[Feature] qlora support (#5586) ... * [feature] qlora support * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * qlora follow commit * migrate qutization folder to colossalai/ * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * minor fixes --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	2024-04-17 15:03:31 +08:00
Baizhou Zhang	c5fd4aa6e8	[lora] add lora APIs for booster, support lora for TorchDDP (#4981) ... * add apis and peft requirement * add liscense and implement apis * add checkpointio apis * add torchddp fwd_bwd test * add support_lora methods * add checkpointio test and debug * delete unneeded codes * remove peft from LICENSE * add concrete methods for enable_lora * simplify enable_lora api * fix requirements	2023-10-31 15:19:37 +08:00