github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-15 22:19:38 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Hotfix] Fix model policy matching strategy in ShardFormer (#5064)

Browse Source 
* hotfix/Fix get model policy strategy in ShardFormer

* fix bug in auto policy
This commit is contained in:
Zhongkai Zhao
2023-11-22 11:19:39 +08:00
committed by GitHub
parent 4ccb9ded7d
commit 75af66cd81
4 changed files with 8 additions and 42 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/inference/README.md
View File

@@ -32,7 +32,7 @@ Colossal Inference is composed of three main components:
In this section we discuss how the colossal inference works and integrates with the `Shardformer` . The details can be found in our codes.
![Colossal-Inference](https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/inference/inference-arch.png)
<img src="https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/inference/inference-arch.png" alt="Colossal-Inference" style="zoom: 33%;"/>
## Roadmap of our implementation