github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-15 06:00:07 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Colossal-Inference] (v0.1.0) Merge pull request #5739 from hpcaitech/feature/colossal-infer

Browse Source 
[Inference] Merge feature/colossal-infer
This commit is contained in:
Yuanheng Zhao
2024-05-22 14:31:09 +08:00
committed by GitHub
parent 22ce873c3f 498f42c45b
commit df6747603f
226 changed files with 20489 additions and 9729 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
colossalai/shardformer/layer/embedding.py
View File

@@ -249,7 +249,6 @@ class VocabParallelEmbedding1D(PaddingParallelModule):
The ``args`` and ``kwargs`` used in :class:``torch.nn.functional.embedding`` should contain:
::
max_norm (float, optional): If given, each embedding vector with norm larger than max_norm is
renormalized to have norm max_norm. Note: this will modify weight in-place.
norm_type (float, optional): The p of the p-norm to compute for the max_norm option. Default 2.