Signed-off-by: Guangya Liu <gyliu@ibm.com>
Signed-off-by: Alex Jones <alexsimonjones@gmail.com>
Co-authored-by: Alex Jones <alexsimonjones@gmail.com>
Co-authored-by: Matthis <matthish29@gmail.com>
This commit adds Top-K sampling, a feature that allows users to control
the randomness of the generated text by specifying the number of most
probable next words considered by the model. This enhances user control
and potentially improves the quality of the generated outputs.
Fixes: https://github.com/k8sgpt-ai/k8sgpt/issues/1105
Signed-off-by: VaibhavMalik4187 <vaibhavmalik2018@gmail.com>
Co-authored-by: Alex Jones <alexsimonjones@gmail.com>
* feat: add Google Vertex AI as provider to utilize gemini via GCP
Signed-off-by: Mario Fahlandt <mfahlandt@pixel-haufen.de>
* fix: adjust providerId description
Signed-off-by: Mario Fahlandt <mfahlandt@pixel-haufen.de>
---------
Signed-off-by: Mario Fahlandt <mfahlandt@pixel-haufen.de>
Signed-off-by: Alex Jones <alexsimonjones@gmail.com>
Co-authored-by: Alex Jones <alexsimonjones@gmail.com>
Co-authored-by: Aris Boutselis <arisboutselis08@gmail.com>
* refactor: Simplified IAI; made caching and processing consisent.
Signed-off-by: bwplotka <bwplotka@gmail.com>
* feat: Added Google AI API e.g. for Gemini models.
Signed-off-by: bwplotka <bwplotka@gmail.com>
---------
Signed-off-by: bwplotka <bwplotka@gmail.com>
Co-authored-by: Alex Jones <alexsimonjones@gmail.com>
Co-authored-by: Thomas Schuetz <38893055+thschue@users.noreply.github.com>
* add amazonbedrock AI provider
Signed-off-by: Su Wei <suwei007@gmail.com>
* add amazonbedrock, change model list to const var
Signed-off-by: Su Wei <suwei007@gmail.com>
* update iai config and auth cmd, add providerRegion
Signed-off-by: Wei Su <wsuam@amazon.com>
* fix filename wrong
Signed-off-by: Wei Su <wsuam@amazon.com>
* chore: added some doc info
Signed-off-by: Alex Jones <alexsimonjones@gmail.com>
---------
Signed-off-by: Su Wei <suwei007@gmail.com>
Signed-off-by: Wei Su <wsuam@amazon.com>
Signed-off-by: Alex Jones <alexsimonjones@gmail.com>
Co-authored-by: Wei Su <wsuam@amazon.com>
Co-authored-by: Aris Boutselis <aris.boutselis@senseon.io>
Co-authored-by: Alex Jones <alexsimonjones@gmail.com>
* feat: openAI explicit value for maxToken and temp
Because when k8sgpt talks with vLLM, the default MaxToken is 16,
which is so small.
Given the most model supports 2048 token(like Llama1 ..etc), so
put here for a safe value.
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
* feat: make temperature a flag
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
---------
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
* feat: added the ability to set a user default AI provider
Signed-off-by: Alex Jones <alexsimonjones@gmail.com>
* feat: added the ability to set a user default AI provider
Signed-off-by: Alex Jones <alexsimonjones@gmail.com>
* chore: added provider to json output
Signed-off-by: Alex Jones <alexsimonjones@gmail.com>
---------
Signed-off-by: Alex Jones <alexsimonjones@gmail.com>
Instead of storing cached values in the config yaml, they are now stored
under these OS specific locations:
* Linux: `~/.cache/k8sgpt`
* MacOS: `~/Library/Caches`
* Windows: `%LocalAppData%\cache`
Additionally a `Cache` package and interface has been introduced.
Currently there are two implementations:
* Noop - Doesn't do anything
* FileBased - Stores data in files under the locations listed above
fixes#323
Signed-off-by: Patrick Pichler <git@patrickpichler.dev>
* feat: allow to set a baseURL for OpenAI providers
This allows to run local models that have a compatible OpenAI API, or
for instance use a proxy.
Signed-off-by: mudler <mudler@mocaccino.org>
* feat: allow to set baseURL in the auth subcommand
Signed-off-by: mudler <mudler@mocaccino.org>
---------
Signed-off-by: mudler <mudler@mocaccino.org>
Co-authored-by: Alex Jones <alexsimonjones@gmail.com>
Co-authored-by: Matthis <99146727+matthisholleville@users.noreply.github.com>
* chore: add fakeai provider
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
* chore: add fakeai provider
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
* fix: name of openai provider
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
* fix: renamed fakeai backend to noopai
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
* fix: renamed fakeai backend to noopai
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
---------
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
Co-authored-by: Alex Jones <alexsimonjones@gmail.com>
This commit adds support for a new configuration format that is not backwards compatible with the previous format. This is a breaking change and requires users to update their configuration files to use the new format.
BREAKING CHANGE: The format of the configuration file has changed. Users must update their configuration files to use the new format.
Signed-off-by: Matthis Holleville <matthish29@gmail.com>
* chore: analyzer and ai interfacing
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
* fix: backend variable for aiProvider in cmd
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
* fix: changed folders for analyzers
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
* chore: renamed analyzers
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
* fix: fixed ingress tests after rebase
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
* fix: fixed ingress tests after rebase
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
---------
Signed-off-by: Thomas Schuetz <thomas.schuetz@t-sc.eu>
