groq[patch]: update model used for llama tests (#25542)

`llama-3.1-8b-instant` often fails some of the tool calling standard
tests. Here we update to `llama-3.1-70b-versatile`.
This commit is contained in:
ccurme
2024-08-19 09:58:06 -04:00
committed by GitHub
parent 75c3c81b8c
commit 5a3aaae6dc

View File

@@ -28,7 +28,7 @@ class TestGroqLlama(BaseTestGroq):
@property
def chat_model_params(self) -> dict:
return {
"model": "llama-3.1-8b-instant",
"model": "llama-3.1-70b-versatile",
"temperature": 0,
"rate_limiter": rate_limiter,
}