Bagatur cab55e9bc1 add vertex prod features (#10910) ...

- chat vertex async
- vertex stream
- vertex full generation info
- vertex use server-side stopping
- model garden async
- update docs for all the above

in follow up will add
[] chat vertex full generation info
[] chat vertex retries
[] scheduled tests

2023-09-22 01:44:09 -07:00

3.7 KiB

Raw Blame History

View Raw