Commit Graph

206 Commits

Author SHA1 Message Date
digger-yu
6e7e43c6fe
[doc] Update .github/workflows/README.md (#3577)
Optimization Code
I think there were two extra $ entered here, which have been deleted
2023-04-17 16:27:38 +08:00
Frank Lee
80eba05b0a
[test] refactor tests with spawn (#3452)
* [test] added spawn decorator

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
2023-04-06 14:51:35 +08:00
Hakjin Lee
1653063fce
[CI] Fix pre-commit workflow (#3238) 2023-03-27 09:41:08 +08:00
Frank Lee
169ed4d24e
[workflow] purged extension cache before GPT test (#3128) 2023-03-14 10:11:32 +08:00
Frank Lee
91ccf97514
[workflow] fixed doc build trigger condition (#3072) 2023-03-09 17:31:41 +08:00
Frank Lee
8fedc8766a
[workflow] supported conda package installation in doc test (#3028)
* [workflow] supported conda package installation in doc test

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
2023-03-07 14:21:26 +08:00
Frank Lee
2cd6ba3098
[workflow] fixed the post-commit failure when no formatting needed (#3020)
* [workflow] fixed the post-commit failure when no formatting needed

* polish code

* polish code

* polish code
2023-03-07 13:35:45 +08:00
Frank Lee
2e427ddf42
[revert] recover "[refactor] restructure configuration files (#2977)" (#3022)
This reverts commit 35c8f4ce47.
2023-03-07 13:31:23 +08:00
Saurav Maheshkar
35c8f4ce47
[refactor] restructure configuration files (#2977)
* gh: move CONTRIBUTING to .github

* chore: move isort config to pyproject

* chore: move pytest config to pyproject

* chore: move yapf config to pyproject

* chore: move clang-format config to pre-commit
2023-03-05 20:29:34 +08:00
Frank Lee
77b88a3849
[workflow] added auto doc test on PR (#2929)
* [workflow] added auto doc test on PR

* [workflow] added doc test workflow

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
2023-02-28 11:10:38 +08:00
Frank Lee
e33c043dec
[workflow] moved pre-commit to post-commit (#2895) 2023-02-24 14:41:33 +08:00
LuGY
dbd0fd1522
[CI/CD] fix nightly release CD running on forked repo (#2812)
* [CI/CD] fix nightly release CD running on forker repo

* fix misunderstanding of dispatch

* remove some build condition, enable notify even when release failed
2023-02-18 13:27:13 +08:00
ver217
9c0943ecdb
[chatgpt] optimize generation kwargs (#2717)
* [chatgpt] ppo trainer use default generate args

* [chatgpt] example remove generation preparing fn

* [chatgpt] benchmark remove generation preparing fn

* [chatgpt] fix ci
2023-02-15 13:59:58 +08:00
Frank Lee
2045d45ab7
[doc] updated documentation version list (#2715) 2023-02-15 11:24:18 +08:00
ver217
f6b4ca4e6c
[devops] add chatgpt ci (#2713) 2023-02-15 10:53:54 +08:00
Frank Lee
89f8975fb8
[workflow] fixed tensor-nvme build caching (#2711) 2023-02-15 10:12:55 +08:00
Frank Lee
5cd8cae0c9
[workflow] fixed communtity report ranking (#2680) 2023-02-13 17:04:49 +08:00
Frank Lee
c44fd0c867
[workflow] added trigger to build doc upon release (#2678) 2023-02-13 16:53:26 +08:00
Frank Lee
327bc06278
[workflow] added doc build test (#2675)
* [workflow] added doc build test

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
2023-02-13 15:55:57 +08:00
Frank Lee
94f87f9651
[workflow] fixed gpu memory check condition (#2659) 2023-02-10 09:59:07 +08:00
Frank Lee
85b2303b55
[doc] migrate the markdown files (#2652) 2023-02-09 14:21:38 +08:00
Frank Lee
8518263b80
[test] fixed the triton version for testing (#2608) 2023-02-07 13:49:38 +08:00
Frank Lee
aa7e9e4794
[workflow] fixed the test coverage report (#2614)
* [workflow] fixed the test coverage report

* polish code
2023-02-07 11:50:53 +08:00
Frank Lee
b3973b995a
[workflow] fixed test coverage report (#2611) 2023-02-07 11:02:56 +08:00
Frank Lee
f566b0ce6b
[workflow] fixed broken rellease workflows (#2604) 2023-02-06 21:40:19 +08:00
Frank Lee
f7458d3ec7
[release] v0.2.1 (#2602)
* [release] v0.2.1

* polish code
2023-02-06 20:46:18 +08:00
Frank Lee
719c4d5553
[doc] updated readme for CI/CD (#2600) 2023-02-06 17:42:15 +08:00
Frank Lee
4d582893a7
[workflow] added cuda extension build test before release (#2598)
* [workflow] added cuda extension build test before release

* polish code
2023-02-06 17:07:41 +08:00
Frank Lee
0c03802bff
[workflow] hooked pypi release with lark (#2596) 2023-02-06 16:29:04 +08:00
Frank Lee
fd90245399
[workflow] hooked docker release with lark (#2594) 2023-02-06 16:15:46 +08:00
Frank Lee
d6cc8f313e
[workflow] added test-pypi check before release (#2591)
* [workflow] added test-pypi check before release

* polish code
2023-02-06 15:42:08 +08:00
Frank Lee
2059408edc
[workflow] fixed the typo in the example check workflow (#2589) 2023-02-06 15:03:54 +08:00
Frank Lee
5767f8e394
[workflow] hook compatibility test failure to lark (#2586) 2023-02-06 14:56:31 +08:00
Frank Lee
186ddce2c4
[workflow] hook example test alert with lark (#2585) 2023-02-06 14:38:35 +08:00
Frank Lee
788e138960
[workflow] added notification if scheduled build fails (#2574)
* [workflow] added notification if scheduled build fails

* polish code

* polish code
2023-02-06 14:03:13 +08:00
Frank Lee
8af5a0799b
[workflow] added discussion stats to community report (#2572)
* [workflow] added discussion stats to community report

* polish code
2023-02-06 13:47:59 +08:00
Frank Lee
b0c29d1b4c
[workflow] refactored compatibility test workflow for maintenability (#2560) 2023-02-06 13:47:50 +08:00
Frank Lee
76edb04b0d
[workflow] adjust the GPU memory threshold for scheduled unit test (#2558)
* [workflow] adjust the GPU memory threshold for scheduled unit test

* polish code
2023-02-06 13:47:25 +08:00
Frank Lee
ba47517342
[workflow] fixed example check workflow (#2554)
* [workflow] fixed example check workflow

* polish yaml
2023-02-06 13:46:52 +08:00
Frank Lee
fb1a4c0d96
[doc] fixed issue link in pr template (#2577) 2023-02-06 10:29:24 +08:00
Frank Lee
2eb4268b47
[workflow] fixed typos in the leaderboard workflow (#2567) 2023-02-03 17:25:56 +08:00
Frank Lee
7b4ad6e0fc
[workflow] added contributor and user-engagement report (#2564)
* [workflow] added contributor and user-engagement report

* polish code

* polish code
2023-02-03 17:12:35 +08:00
Frank Lee
578374d0de
[doc] fixed the typo in pr template (#2556) 2023-02-03 10:47:00 +08:00
Frank Lee
8438c35a5f
[doc] added pull request template (#2550)
* [doc] added pull  request template

* polish code

* polish code
2023-02-02 18:16:03 +08:00
Frank Lee
b55deb0662
[workflow] only report coverage for changed files (#2524)
* [workflow] only report coverage for changed files

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file

* polish file
2023-01-30 21:28:27 +08:00
Frank Lee
0af793836c
[workflow] fixed changed file detection (#2515) 2023-01-26 16:34:19 +08:00
Frank Lee
579dba572f
[workflow] fixed the skip condition of example weekly check workflow (#2481) 2023-01-16 10:05:41 +08:00
Frank Lee
32c46e146e
[workflow] automated bdist wheel build (#2459)
* [workflow] automated bdist wheel build

* polish workflow

* polish readme

* polish readme
2023-01-12 10:57:02 +08:00
Frank Lee
c9ec5190a0
[workflow] automated the compatiblity test (#2453)
* [workflow] automated the compatiblity test

* polish code
2023-01-11 23:40:16 +08:00
Frank Lee
483efdabc5
[workflow] fixed the on-merge condition check (#2452) 2023-01-11 17:22:11 +08:00
Frank Lee
1b7587d958
[workflow] make test coverage report collapsable (#2436) 2023-01-11 13:37:48 +08:00
Frank Lee
a3e5496156
[example] improved the clarity yof the example readme (#2427)
* [example] improved the clarity yof the example readme

* polish workflow

* polish workflow

* polish workflow

* polish workflow

* polish workflow

* polish workflow
2023-01-11 10:46:32 +08:00
Frank Lee
21256674e9
[workflow] report test coverage even if below threshold (#2431) 2023-01-11 10:44:52 +08:00
Frank Lee
cd38167c1a
[doc] added documentation for CI/CD (#2420)
* [doc] added documentation for CI/CD

* polish markdown

* polish markdown

* polish markdown
2023-01-10 22:30:32 +08:00
Frank Lee
b3472d32e0
[workflow]auto comment with test coverage report (#2419)
* [workflow]auto comment with test coverage report

* polish code

* polish yaml
2023-01-10 22:30:16 +08:00
Frank Lee
57b6157b6c
[workflow] auto comment if precommit check fails (#2417) 2023-01-10 15:06:27 +08:00
Frank Lee
9d432230ba
[workflow] added translation for non-english comments (#2414) 2023-01-10 12:06:01 +08:00
Frank Lee
4befaabace
[workflow] added precommit check for code consistency (#2401)
* [workflow] added precommit check for code consistency

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
2023-01-10 11:40:04 +08:00
Frank Lee
8327932d2c
[workflow] refactored the example check workflow (#2411)
* [workflow] refactored the example check workflow

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
2023-01-10 11:26:19 +08:00
Frank Lee
8de8de9fa3
[docker] updated Dockerfile and release workflow (#2410) 2023-01-10 09:26:14 +08:00
Frank Lee
53bb8682a2
[worfklow] added coverage test (#2399)
* [worfklow] added coverage test

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code

* polish code
2023-01-09 17:57:57 +08:00
Frank Lee
d3f5ce9efb
[workflow] added nightly release to pypi (#2403) 2023-01-09 16:21:44 +08:00
Frank Lee
2add870138
[workflow] added missing file change detection output (#2387) 2023-01-09 09:18:44 +08:00
ziyuhuang123
7080a8edb0
[workflow]New version: Create workflow files for examples' auto check (#2298)
* [workflows]bug_repair

* [workflow]new_pr_fixing_bugs

Co-authored-by: binmakeswell <binmakeswell@gmail.com>
2023-01-06 09:26:49 +08:00
Frank Lee
f1bc2418c4
[setup] make cuda extension build optional (#2336)
* [setup] make cuda extension build optional

* polish code

* polish code

* polish code
2023-01-05 15:13:11 +08:00
Frank Lee
6e34cc0830
[workflow] fixed pypi release workflow error (#2328) 2023-01-05 10:52:43 +08:00
Frank Lee
2916eed34a
[workflow] fixed pypi release workflow error (#2327) 2023-01-05 10:48:38 +08:00
Frank Lee
8d8dec09ba
[workflow] added workflow to release to pypi upon version change (#2320)
* [workflow] added workflow to release to pypi upon version change

* polish code

* polish code

* polish code
2023-01-05 10:40:18 +08:00
Frank Lee
693ef121a1
[workflow] removed unused assign reviewer workflow (#2318) 2023-01-05 10:40:07 +08:00
Frank Lee
e8dfa2e2e0
[workflow] rebuild cuda kernels when kernel-related files change (#2317) 2023-01-04 17:23:59 +08:00
binmakeswell
bb6245612d
[GitHub] update issue template (#2023)
* Update bug-report.yml

* Update documentation.yml

* Update bug-report.yml

* Update feature_request.yml

* Update proposal.yml
2022-11-25 09:13:27 +08:00
Frank Lee
254ee2c54f
[workflow] removed unused pypi release workflow (#2022) 2022-11-24 17:27:55 +08:00
Frank Lee
7242bffc5f
[workflow] fixed the python and cpu arch mismatch (#2010) 2022-11-23 17:24:17 +08:00
Frank Lee
56a3dcdabd
[workflow] fixed the typo in condarc (#2006) 2022-11-23 16:05:30 +08:00
Frank Lee
7ad9bd14d8
[workflow] added conda cache and fixed no-compilation bug in release (#2005) 2022-11-23 15:52:42 +08:00
ver217
f8a7148dec
[kernel] move all symlinks of kernel to colossalai._C (#1971) 2022-11-17 13:42:33 +08:00
yuxuan-lou
cc27adceb0
[NFC] polish .github/workflows/scripts/build_colossalai_wheel.py code style (#1856) 2022-11-09 16:54:09 +08:00
Ofey Chan
e5b1a0c9be
[NFC] polish .github/workflows/scripts/generate_release_draft.py code style (#1855) 2022-11-09 15:28:33 +08:00
Kai Wang (Victor Kai)
a3b1d07ca4
[NFC] polish workflows code style (#1854) 2022-11-09 14:50:09 +08:00
RichardoLuo
81a642fe8d
[NFC] polish <.github/workflows/release_nightly.yml> code style (#1851)
Co-authored-by: RichardoLuo <14049555596@qq.com>
2022-11-09 14:48:53 +08:00
xyupeng
b0a138aa22 [NFC] polish .github/workflows/build.yml code style (#1837) 2022-11-09 12:08:47 +08:00
Maruyama_Aya
90833b45dd [NFC] polish .github/workflows/release_docker.yml code style 2022-11-09 12:08:47 +08:00
shenggan
b0706fbb00 [NFC] polish .github/workflows/submodule.yml code style (#1822) 2022-11-09 12:08:47 +08:00
Arsmart1
fc8d8b1b9c [NFC] polish .github/workflows/draft_github_release_post.yml code style (#1820) 2022-11-09 12:08:47 +08:00
Zangwei Zheng
25993db98a [NFC] polish .github/workflows/build_gpu_8.yml code style (#1813) 2022-11-09 12:08:47 +08:00
Arsmart1
8860d37846 [NFC] polish .github/workflows/scripts/build_colossalai_wheel.py code style (#1721) 2022-10-19 12:20:51 +08:00
Frank Lee
9d0560af9c
[workflow] handled the git directory ownership error (#1741) 2022-10-19 11:59:11 +08:00
Frank Lee
725666d6a9
[workflow] deactivate conda environment before removing (#1606) 2022-09-19 12:05:33 +08:00
Frank Lee
6474e31556
[workflow] added TensorNVMe to compatibility test (#1449) 2022-08-12 17:06:29 +08:00
ver217
c415240db6
[nvme] CPUAdam and HybridAdam support NVMe offload (#1360)
* impl nvme optimizer

* update cpu adam

* add unit test

* update hybrid adam

* update docstr

* add TODOs

* update CI

* fix CI

* fix CI

* fix CI path

* fix CI path

* fix CI path

* fix install tensornvme

* fix CI

* fix CI path

* fix CI env variables

* test CI

* test CI

* fix CI

* fix nvme optim __del__

* fix adam __del__

* fix nvme optim

* fix CI env variables

* fix nvme optim import

* test CI

* test CI

* fix CI
2022-07-26 17:25:24 +08:00
Frank Lee
11d1436a67
[workflow] update docker build workflow to use proxy (#1334) 2022-07-18 14:09:41 +08:00
Frank Lee
069d6fdc84
[workflow] update 8-gpu test to use torch 1.11 (#1332) 2022-07-18 11:41:13 +08:00
Frank Lee
659a740738
[workflow] roll back to use torch 1.11 for unit testing (#1325) 2022-07-15 17:20:17 +08:00
Frank Lee
4d5dbf48a6
[workflow] fixed trigger condition for 8-gpu unit test (#1323) 2022-07-15 15:00:02 +08:00
Frank Lee
7c2634f4b3
[workflow] updated release bdist workflow (#1318)
* [workflow] updated release bdist workflow

* polish workflow

* polish workflow
2022-07-15 09:40:58 +08:00
Frank Lee
efdc240f1f
[workflow] disable SHM for compatibility CI on rtx3080 (#1315) 2022-07-14 17:44:43 +08:00
Frank Lee
c9c37dcc4d
[workflow] updated pytorch compatibility test (#1311) 2022-07-14 16:45:17 +08:00
lucasliunju
339520c6e0
[NFC] polish build_colossalai_wheel.py code style (#1306) 2022-07-14 10:41:01 +08:00
Frank Lee
ca73028a3a
[workflow] auto-publish docker image upon release (#1164) 2022-06-23 14:51:59 +08:00
Frank Lee
d415d73286
[workflow] fixed release post workflow (#1154) 2022-06-22 11:55:21 +08:00