mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-09-16 22:52:25 +00:00
fixed some typos in the documents, added blog link and paper author information in README
This commit is contained in:
19
README.md
19
README.md
@@ -1,8 +1,10 @@
|
||||
# ColossalAI
|
||||
# Colossal-AI
|
||||
|
||||
An integrated large-scale model training system with efficient parallelization techniques.
|
||||
|
||||
arXiv: [Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training](https://arxiv.org/abs/2110.14883)
|
||||
Paper: [Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training](https://arxiv.org/abs/2110.14883)
|
||||
|
||||
Blog: [Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training](https://www.hpcaitech.com/blog)
|
||||
|
||||
## Installation
|
||||
|
||||
@@ -91,16 +93,25 @@ class MLP_2D(nn.Module):
|
||||
|
||||
## Features
|
||||
|
||||
ColossalAI provides a collection of parallel training components for you. We aim to support you to write your
|
||||
Colossal-AI provides a collection of parallel training components for you. We aim to support you to write your
|
||||
distributed deep learning models just like how you write your single-GPU model. We provide friendly tools to kickstart
|
||||
distributed training in a few lines.
|
||||
|
||||
- [Data Parallelism](./docs/parallelization.md)
|
||||
- [Pipeline Parallelism](./docs/parallelization.md)
|
||||
- [1D, 2D, 2.5D, 3D and sequence parallelism](./docs/parallelization.md)
|
||||
- [friendly trainer and engine](./docs/trainer_engine.md)
|
||||
- [Friendly trainer and engine](./docs/trainer_engine.md)
|
||||
- [Extensible for new parallelism](./docs/add_your_parallel.md)
|
||||
- [Mixed Precision Training](./docs/amp.md)
|
||||
- [Zero Redundancy Optimizer (ZeRO)](./docs/zero.md)
|
||||
|
||||
## Cite Us
|
||||
|
||||
```
|
||||
@article{bian2021colossal,
|
||||
title={Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training},
|
||||
author={Bian, Zhengda and Liu, Hongxin and Wang, Boxiang and Huang, Haichen and Li, Yongbin and Wang, Chuanrui and Cui, Fan and You, Yang},
|
||||
journal={arXiv preprint arXiv:2110.14883},
|
||||
year={2021}
|
||||
}
|
||||
```
|
||||
|
Reference in New Issue
Block a user