github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-09-06 21:43:44 +00:00
Code Issues Packages Projects Releases Wiki Activity

Simplify eval arg names (#6944)

Browse Source 
It'll be easier to switch between these if the names of predictions are
consistent
This commit is contained in:
William FH
2023-06-30 07:47:53 -07:00
committed by GitHub
parent 8f5eca236f
commit 8c73037dff
8 changed files with 52 additions and 51 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/extras/guides/evaluation/comparisons.ipynb
View File

@@ -243,8 +243,8 @@
" pred_a, pred_b = res_b, res_a\n",
" a, b = \"b\", \"a\"\n",
" eval_res = eval_chain.evaluate_string_pairs(\n",
" output_a=pred_a['output'] if isinstance(pred_a, dict) else str(pred_a),\n",
" output_b=pred_b['output'] if isinstance(pred_b, dict) else str(pred_b),\n",
" prediction=pred_a['output'] if isinstance(pred_a, dict) else str(pred_a),\n",
" prediction_b=pred_b['output'] if isinstance(pred_b, dict) else str(pred_b),\n",
" input=input_\n",
" )\n",
" if eval_res[\"value\"] == \"A\":\n",