Baizhou Zhang 14b0d4c7e5 [lora] add lora APIs for booster, support lora for TorchDDP (#4981) ...

* add apis and peft requirement

* add liscense and implement apis

* add checkpointio apis

* add torchddp fwd_bwd test

* add support_lora methods

* add checkpointio test and debug

* delete unneeded codes

* remove peft from LICENSE

* add concrete methods for enable_lora

* simplify enable_lora api

* fix requirements

2024-04-28 10:51:27 +08:00

..

__init__.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

checkpoint_io_base.py

[lora] add lora APIs for booster, support lora for TorchDDP (#4981)

2024-04-28 10:51:27 +08:00

general_checkpoint_io.py

[lora] add lora APIs for booster, support lora for TorchDDP (#4981)

2024-04-28 10:51:27 +08:00

hybrid_parallel_checkpoint_io.py

[shardformer] refactor embedding resize (#5603)

2024-04-18 16:10:18 +08:00

index_file.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

utils.py

[shardformer] refactor embedding resize (#5603)

2024-04-18 16:10:18 +08:00