github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-08-17 16:39:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

Improve notebook wording (#18472)

Browse Source
This commit is contained in:
William FH 2024-03-03 18:31:15 -08:00 committed by GitHub
parent 1eec67e8fe
commit 1cdb813196
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 5 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
docs/docs/langsmith/walkthrough.ipynb
View File

@ -400,12 +400,12 @@
"id": "1cc51d0a-4982-4ff9-89c1-b294d5cce8f6",
"metadata": {},
"source": [
"#### Aggregate Evaluators\n",
"#### Batch Evaluators\n",
"\n",
"Some metrics are only performed in aggregate or full \"test session\" level. These could be simple \n",
"classification metrics like Precision, Recall, or AUC, or other custom metrics.\n",
"Some metrics are aggregated over a full \"test\" without being assigned to an individual runs/examples. These could be as simple \n",
"as common classification metrics like Precision, Recall, or AUC, or it could be another custom aggregate metric.\n",
"\n",
"You can define any custom metric on an aggregate level using a callable that accepts a list of Runs (system traces) and list of Examples (dataset records)."
"You can define any batch metric on a full test level by defining a function (or any callable) that accepts a list of Runs (system traces) and list of Examples (dataset records)."
]
},
{
@ -476,7 +476,7 @@
" normalize_by=10,\n",
" ),\n",
" ],\n",
" aggregate_evaluators=[max_pred_length],\n",
" batch_evaluators=[max_pred_length],\n",
")"
]
},