github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-23 18:39:56 +00:00
Code Issues Packages Projects Releases Wiki Activity

[fix] rm use_zbv flag in Shardconfig; rm debug info;

Browse Source
This commit is contained in:
duanjunwen
2024-10-16 03:25:04 +00:00
parent 90939b77e0
commit e76308c6e6
9 changed files with 212 additions and 651 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/language/llama/benchmark.py
View File

@@ -5,8 +5,6 @@ import warnings
from contextlib import nullcontext
import torch
torch.autograd.set_detect_anomaly(True)
import torch.distributed as dist
from data_utils import RandomDataset
from model_utils import format_numel_str, get_model_numel