github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-05 11:02:05 +00:00
Code Issues Packages Projects Releases Wiki Activity

Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806)

Browse Source
This commit is contained in:
Jiarui Fang
2022-04-19 14:40:02 +08:00
committed by GitHub
parent 88759e289e
commit e761ad2cd7
12 changed files with 11 additions and 214 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
setup.py
View File

@@ -134,12 +134,6 @@ if build_cuda_ext:
'nvcc': append_nvcc_threads(['-O3', '--use_fast_math'] + version_dependent_macros + extra_cuda_flags)
})
ext_modules.append(
cuda_ext_helper(name='colossal_zero_comm',
sources=['zero_comm.cpp'],
extra_cuda_flags=['-DUSE_C10D_NCCL'],
extra_cxx_flags=['-DUSE_C10D_NCCL']))
ext_modules.append(
cuda_ext_helper('colossal_C', [
'colossal_C_frontend.cpp', 'multi_tensor_sgd_kernel.cu', 'multi_tensor_scale_kernel.cu',