github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-03 10:06:44 +00:00
Code Issues Packages Projects Releases Wiki Activity

[doc] Fix typo (#5361)

Browse Source
This commit is contained in:
yixiaoer
2024-02-19 16:53:28 +08:00
committed by GitHub
parent 7303801854
commit 69e3ad01ed
1 changed files with 1 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/zh-Hans/features/1D_tensor_parallel.md
View File

@@ -19,10 +19,8 @@
当第二个线性层 $Z=YB$ 跟随上述列并行层的时候, 我们把 $B$ 划分为
$$
\left[\begin{matrix} B_1 \\ B_2 \end{matrix} \right]
```
这就是所谓的行并行方式.
$$
这就是所谓的行并行方式.
为了计算
$$
Z = [Y_1 ~ Y_2] \left[\begin{matrix} B_1 \\ B_2 \end{matrix} \right]