github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-06-05 21:52:06 +00:00
Code Issues Packages Projects Releases Wiki Activity

[doc] Fix typo (#5361)

Browse Source
This commit is contained in:
yixiaoer 2024-02-19 16:53:28 +08:00 committed by GitHub
parent 7303801854
commit 69e3ad01ed
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/zh-Hans/features/1D_tensor_parallel.md
View File

@ -19,10 +19,8 @@
当第二个线性层 $Z=YB$ 跟随上述列并行层的时候, 我们把 $B$ 划分为 当第二个线性层 $Z=YB$ 跟随上述列并行层的时候, 我们把 $B$ 划分为
$$ $$
\left[\begin{matrix} B_1 \\ B_2 \end{matrix} \right] \left[\begin{matrix} B_1 \\ B_2 \end{matrix} \right]
```
这就是所谓的行并行方式.
$$ $$
这就是所谓的行并行方式.
为了计算 为了计算
$$ $$
Z = [Y_1 ~ Y_2] \left[\begin{matrix} B_1 \\ B_2 \end{matrix} \right] Z = [Y_1 ~ Y_2] \left[\begin{matrix} B_1 \\ B_2 \end{matrix} \right]