1
0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-05 02:51:59 +00:00

10 Commits

Author SHA1 Message Date
Hongxin Liu
7f8b16635b [misc] refactor launch API and tensor constructor ()
* [misc] remove config arg from initialize

* [misc] remove old tensor contrusctor

* [plugin] add npu support for ddp

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [devops] fix doc test ci

* [test] fix test launch

* [doc] update launch doc

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-04-29 10:40:11 +08:00
Hongxin Liu
079bf3cb26 [misc] update pre-commit and run all files ()
* [misc] update pre-commit

* [misc] run pre-commit

* [misc] remove useless configuration files

* [misc] ignore cuda for clang-format
2023-09-19 14:20:26 +08:00
github-actions[bot]
c77b3b19be [format] applied code formatting on changed files in pull request 4152 ()
Co-authored-by: github-actions <github-actions@github.com>
2023-07-04 16:07:47 +08:00
Kun Lin
8af29ee47a [shardformer] support vision transformer ()
* first v of vit shardformer

* keep vit

* update

* vit shard add vitattention vitlayer

* update num head shard para

* finish test for vit

* add new_model_class & postprocess

* add vit readme

* delete old files & fix the conflict

* fix sth
2023-07-04 16:05:01 +08:00
Frank Lee
c4b1b65931 [test] fixed tests failed due to dtensor change ()
* [test] fixed tests failed due to dtensor change

* polish code
2023-07-04 16:05:01 +08:00
Frank Lee
611971248c [device] support init device mesh from process group () 2023-07-04 16:05:01 +08:00
github-actions[bot]
a52f62082d [format] applied code formatting on changed files in pull request 4021 ()
Co-authored-by: github-actions <github-actions@github.com>
2023-06-19 11:23:24 +08:00
Frank Lee
ddcf58cacf Revert "[sync] sync feature/shardformer with develop" 2023-06-09 09:41:27 +08:00
Frank Lee
eb39154d40 [dtensor] updated api and doc () 2023-06-08 10:18:17 +08:00
YuliangLiu0306
0442f940f0 [device] add DeviceMesh class to support logical device layout ()
* [device] add DeviceMesh class to support logical device layout

* polish code

* add doc string
2022-08-02 19:23:48 +08:00