mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-09-08 20:40:34 +00:00
[nfc] fix typo colossalai/nn (#3887)
* fix typo colossalai/autochunk auto_parallel amp * fix typo colossalai/auto_parallel nn utils etc. * fix typo colossalai/auto_parallel autochunk fx/passes etc. * fix typo docs/ * change placememt_policy to placement_policy in docs/ and examples/ * fix typo colossalai/ applications/ * fix typo colossalai/cli fx kernel * fix typo colossalai/nn * revert change warmuped
This commit is contained in:
@@ -21,7 +21,7 @@ class CPUAdam(NVMeOptimizer):
|
||||
|
||||
`CPUAdam` requires CUDA extensions which can be built during installation or runtime.
|
||||
|
||||
This version of CPU Adam accelates parameters updating on CPU with SIMD.
|
||||
This version of CPU Adam accelerates parameters updating on CPU with SIMD.
|
||||
Support of AVX2 or AVX512 is required.
|
||||
|
||||
The GPU part is implemented in an naive way.
|
||||
|
Reference in New Issue
Block a user