[pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci
This commit is contained in:
pre-commit-ci[bot]
2024-05-28 08:02:42 +00:00
committed by YeAnbang
parent b1031f7244
commit 1b880ce095
26 changed files with 69 additions and 57 deletions

View File

@@ -226,7 +226,7 @@ def main():
"max_length": args.max_length,
},
keep_in_memory=False,
num_proc= min(len(dataset), cpu_count()),
num_proc=min(len(dataset), cpu_count()),
)
dataset = dataset.filter(