github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-07-19 18:00:43 +00:00
Code Issues Packages Projects Releases Wiki Activity

[doc] fix op_builder/README.md (#3597)

Browse Source 
Optimization Code
change "requries" to "requires"
This commit is contained in:
digger-yu 2023-04-19 15:56:01 +08:00 committed by GitHub
parent 12eff9eb4c
commit 7570d9ae3d
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
op_builder/README.md
View File

@ -16,7 +16,7 @@ Method 2 is good because it allows the user to only build the kernel they actual
## PyTorch Extensions in Colossal-AI ## PyTorch Extensions in Colossal-AI
The project [DeepSpeed](https://github.com/microsoft/DeepSpeed) has proposed a [solution](https://github.com/microsoft/DeepSpeed/tree/master/op_builder) to support kernel-build during either installation or runtime. The project [DeepSpeed](https://github.com/microsoft/DeepSpeed) has proposed a [solution](https://github.com/microsoft/DeepSpeed/tree/master/op_builder) to support kernel-build during either installation or runtime.
We have adapted from DeepSpeed's solution to build extensions. The extension build requries two main functions from PyTorch: We have adapted from DeepSpeed's solution to build extensions. The extension build requires two main functions from PyTorch:
1. `torch.utils.cpp_extension.CUDAExtension`: used to build extensions in `setup.py` during `pip install`. 1. `torch.utils.cpp_extension.CUDAExtension`: used to build extensions in `setup.py` during `pip install`.
2. `torch.utils.cpp_extension.load`: used to build and load extension during runtime 2. `torch.utils.cpp_extension.load`: used to build and load extension during runtime