langchain/docs
Supreet Takkar ae33979813
community[patch]: Allow adding ARNs as model_id to support Amazon Bedrock custom models (#16800)
- **Description:** Adds an additional class variable to `BedrockBase`
called `provider` that allows sending a model provider such as amazon,
cohere, ai21, etc.
Up until now, the model provider is extracted from the `model_id` using
the first part before the `.`, such as `amazon` for
`amazon.titan-text-express-v1` (see [supported list of Bedrock model IDs
here](https://docs.aws.amazon.com/bedrock/latest/userguide/model-ids-arns.html)).
But for custom Bedrock models where the ARN of the provisioned
throughput must be supplied, the `model_id` is like
`arn:aws:bedrock:...` so the `model_id` cannot be extracted from this. A
model `provider` is required by the LangChain Bedrock class to perform
model-based processing. To allow the same processing to be performed for
custom-models of a specific base model type, passing this `provider`
argument can help solve the issues.
The alternative considered here was the use of
`provider.arn:aws:bedrock:...` which then requires ARN to be extracted
and passed separately when invoking the model. The proposed solution
here is simpler and also does not cause issues for current models
already using the Bedrock class.
  - **Issue:** N/A
  - **Dependencies:** N/A

---------

Co-authored-by: Piyush Jain <piyushjain@duck.com>
2024-02-05 14:28:03 -08:00
..
api_reference langchain[minor], community[minor]: Implement Ontotext GraphDB QA Chain (#16019) 2024-01-29 12:25:53 -08:00
docs community[patch]: Allow adding ARNs as model_id to support Amazon Bedrock custom models (#16800) 2024-02-05 14:28:03 -08:00
scripts docs: fix llm/chat_model tables (#15716) 2024-01-08 11:40:35 -08:00
src docs[patch]: fix zoom (#14786) 2023-12-15 17:46:12 -08:00
static docs: Update with LCEL examples to Ollama & ChatOllama Integration notebook (#16194) 2024-01-22 22:05:59 -08:00
.local_build.sh docs: partner packages (#16960) 2024-02-02 15:12:21 -08:00
babel.config.js Restructure docs (#11620) 2023-10-10 12:55:19 -07:00
code-block-loader.js Restructure docs (#11620) 2023-10-10 12:55:19 -07:00
docusaurus.config.js docs: add changelog (#15606) 2024-01-07 08:34:34 -08:00
package-lock.json docs[patch]: search experiment (#14254) 2023-12-04 16:58:26 -08:00
package.json docs[patch]: search experiment (#14254) 2023-12-04 16:58:26 -08:00
README.md docs: developer docs (#14776) 2023-12-17 12:55:49 -08:00
settings.ini Restructure docs (#11620) 2023-10-10 12:55:19 -07:00
sidebars.js docs: partner packages (#16960) 2024-02-02 15:12:21 -08:00
vercel_build.sh docs: add LangGraph (#15682) 2024-01-08 08:38:14 -08:00
vercel_requirements.txt infra: docs build install community editable (#14739) 2023-12-14 16:13:09 -08:00
vercel.json exa: init pkg (#16553) 2024-01-24 20:57:17 -07:00

LangChain Documentation

For more information on contributing to our documentation, see the Documentation Contributing Guide