github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-11-28 03:46:58 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
65a4dbda6c1e9061cb5d8f375f0f7fc830ba7fc5
ColossalAI/examples/tutorial/fp8/mnist
History
Kirthi Shankar Sivamani 65a4dbda6c [NVIDIA] Add FP8 example using TE (#3080) 
Signed-off-by: Kirthi Shankar Sivamani <ksivamani@nvidia.com>
2023-03-10 16:24:08 +08:00
..
main.py
[NVIDIA] Add FP8 example using TE (#3080)
2023-03-10 16:24:08 +08:00
README.md
[NVIDIA] Add FP8 example using TE (#3080)
2023-03-10 16:24:08 +08:00

README.md

Basic MNIST Example with optional FP8

python main.py
python main.py --use-te   # Linear layers from TransformerEngine
python main.py --use-fp8  # FP8 + TransformerEngine for Linear layers