github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-08-13 13:45:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,848 Commits 59 Branches 51 Tags 237 MiB
hpc-ai-cloud
Commit Graph

3 Commits

Author SHA1 Message Date
Runyu Lu
3c7cda0c9a
[Inference]Lazy Init Support (#5785) 
* lazy init support

* lazy init llama support

* :lazy init support for baichuan

* aligh rpc

* add note for baichuan

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-06-27 18:02:15 +08:00
Runyu Lu
c0948aff97
[Inference]refactor baichuan (#5791) 
* refactor baichuan

* remove unused code and add TODO for lazyinit
 2024-06-11 10:52:01 +08:00
yuehuayingxueluo
5f00002e43
[Inference] Adapt Baichuan2-13B TP (#5659) 
* adapt to baichuan2 13B

* add baichuan2 13B TP

* update baichuan tp logic

* rm unused code

* Fix TP logic

* fix alibi slopes tp logic

* rm nn.Module

* Polished the code.

* change BAICHUAN_MODEL_NAME_OR_PATH

* Modified the logic for loading Baichuan weights.

* fix typos
 2024-04-30 15:47:07 +08:00