github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-01 09:07:51 +00:00
Code Issues Packages Projects Releases Wiki Activity

[gemini] accelerate inference (#3641)

Browse Source 
* [gemini] support don't scatter after inference

* [chat] update colossalai strategy

* [chat] fix opt benchmark

* [chat] update opt benchmark

* [gemini] optimize inference

* [test] add gemini inference test

* [chat] fix unit test ci

* [chat] fix ci

* [chat] fix ci

* [chat] skip checkpoint test
This commit is contained in:
Hongxin Liu
2023-04-26 16:32:40 +08:00
committed by GitHub
parent 4b3240cb59
commit 50793b35f4
13 changed files with 162 additions and 157 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
.github/workflows/run_chatgpt_unit_tests.yml vendored
View File

@@ -32,14 +32,14 @@ jobs:
- name: Install ColossalAI and ChatGPT
run: |
pip install -v .
cd applications/ChatGPT
pip install -e .
cd applications/Chat
pip install -v .
pip install -r requirements-test.txt
- name: Execute Unit Testing
run: |
cd applications/ChatGPT
cd applications/Chat
rm -rf ~/.cache/colossalai
pytest tests/
env: