github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-13 21:22:49 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Inference]Fix example in readme (#6178)

Browse Source
This commit is contained in:
Guangyao Zhang
2025-01-08 11:51:50 +08:00
committed by GitHub
parent ee81366cac
commit 5b094a836b
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/inference/README.md
View File

@@ -62,7 +62,7 @@ engine = InferenceEngine(model, tokenizer, inference_config, verbose=True)
# Step 4: try inference
prompts = ['Who is the best player in the history of NBA?']
response = engine.generate(prompts)
response = engine.generate(prompts=prompts)
pprint(response)
```