github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-30 06:00:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
df6747603f11e2a1929db193ceb014799e02e2c1
ColossalAI/colossalai/inference/executor
History
Yuanheng Zhao 283c407a19 [Inference] Fix Inference Generation Config and Sampling (#5710) 
* refactor and add

* config default values

* fix gen config passing

* fix rpc generation config
2024-05-19 15:08:42 +08:00
..
rpc_worker.py
[Inference] Fix Inference Generation Config and Sampling (#5710)
2024-05-19 15:08:42 +08:00