github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-05-01 13:15:26 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Inference]Fix example in readme ()

Browse Source
This commit is contained in:
Guangyao Zhang 2025-01-08 11:51:50 +08:00 committed by GitHub
parent ee81366cac
commit 5b094a836b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions

2
colossalai/inference/README.md
View File

@ -62,7 +62,7 @@ engine = InferenceEngine(model, tokenizer, inference_config, verbose=True)
# Step 4: try inference
prompts = ['Who is the best player in the history of NBA?']
response = engine.generate(prompts)
response = engine.generate(prompts=prompts)
pprint(response)
```