Commit Graph

7914 Commits

Author SHA1 Message Date
Kazuki Maeda
e44cab5f1b community[minor]: use jq schema for content_key in json_loader (#18003)
### Description
Changed the value specified for `content_key` in JSONLoader from a
single key to a value based on jq schema.
I created [similar
PR](https://github.com/langchain-ai/langchain/pull/11255) before, but it
has several conflicts because of the architectural change associated
stable version release, so I re-create this PR to fit new architecture.

### Why
For json data like the following, specify `.data[].attributes.message`
for page_content and `.data[].attributes.id` or
`.data[].attributes.attributes. tags`, etc., the `content_key` must also
parse the json structure.

<details>
<summary>sample json data</summary>

```json
{
  "data": [
    {
      "attributes": {
        "message": "message1",
        "tags": [
          "tag1"
        ]
      },
      "id": "1"
    },
    {
      "attributes": {
        "message": "message2",
        "tags": [
          "tag2"
        ]
      },
      "id": "2"
    }
  ]
}
```

</details>

<details>
<summary>sample code</summary>

```python
def metadata_func(record: dict, metadata: dict) -> dict:

    metadata["source"] = None
    metadata["id"] = record.get("id")
    metadata["tags"] = record["attributes"].get("tags")

    return metadata

sample_file = "sample1.json"
loader = JSONLoader(
    file_path=sample_file,
    jq_schema=".data[]",
    content_key=".attributes.message", ## content_key is parsable into jq schema
    is_content_key_jq_parsable=True, ## this is added parameter
    metadata_func=metadata_func
)

data = loader.load()
data
```

</details>

### Dependencies
none

### Twitter handle
[kzk_maeda](https://twitter.com/kzk_maeda)
2024-04-25 17:39:07 -07:00
Rodrigo Nogueira
6589b9e507 docs: fix link and missing package (#18405)
**Issue:** fix broken links and missing package on colab example
2024-04-25 17:39:07 -07:00
Max Jakob
364d2d9048 docs: Update elasticsearch README (#18497)
Update Elasticsearch README with information on how to start a
deployment.

Also make some cosmetic changes to the [Elasticsearch
docs](https://python.langchain.com/docs/integrations/vectorstores/elasticsearch).

Follow up on https://github.com/langchain-ai/langchain/pull/17467
2024-04-25 17:39:07 -07:00
Hech
672d356260 community[patch], langchain[minor]: Add retriever self_query and score_threshold in DingoDB (#18106) 2024-04-25 17:39:07 -07:00
Mikhail Khludnev
7b49a8fda0 nvidia-trt[patch]: add TritonTensorRTLLM(verbose_client=False) (#16848)
- **Description:** adding verbose flag to TritonTensorRTLLM, 
  - **Issue:** nope,
  - **Dependencies:** not any,
  - **Twitter handle:**
2024-04-25 17:39:07 -07:00
Bagatur
50f9f63483 docs: query analysis links (#18614) 2024-04-25 17:39:07 -07:00
Asaf Joseph Gardin
32b93f9b4c ai21[patch]: AI21 Labs Contextual Answers support (#18270)
Description: Added support for AI21 Labs model - Contextual Answers
Dependencies: ai21, ai21-tokenizer
Twitter handle: https://github.com/AI21Labs

---------

Co-authored-by: Asaf Gardin <asafg@ai21.com>
Co-authored-by: Erick Friis <erick@langchain.dev>
2024-04-25 17:39:07 -07:00
Erick Friis
e6161068d9 anthropic[patch]: handle lists in function calling (#18609) 2024-04-25 17:39:07 -07:00
Erick Friis
a59b1f3f84 anthropic[patch]: fix argument integration test (#18605) 2024-04-25 17:39:07 -07:00
Leonid Ganeline
61857d71cd docs: providers update 5 (#18550)
Added missed sections. Added descriptions.
2024-04-25 17:39:07 -07:00
Yudhajit Sinha
0a119fc9f7 community[patch]: Invoke callback prior to yielding token (titan_takeoff) (#18560)
## PR title
community[patch]: Invoke callback prior to yielding token

## PR message
- Description: Invoke callback prior to yielding token in _stream_
method in llms/titan_takeoff.
- Issue: #16913 
- Dependencies: None
2024-04-25 17:39:07 -07:00
Tomaz Bratanic
bea3b74fe5 Remove neo4j bloom labels from graph schema (#18564)
Neo4j tools use particular node labels and relationship types to store
metadata, but are irrelevant for text2cypher or graph generation, so we
want to ignore them in the schema representation.
2024-04-25 17:39:07 -07:00
standby24x7
9b605d1f56 docs:Update function "run" to "invoke" in smart_llm.ipynb (#18568)
This patch updates function "run" to "invoke" in smart_llm.ipynb.
Without this patch, you see following warning.

LangChainDeprecationWarning: The function `run` was deprecated in
LangChain 0.1.0 and will be removed in 0.2.0. Use invoke instead.

    Signed-off-by: Masanari Iida <standby24x7@gmail.com>

Signed-off-by: Masanari Iida <standby24x7@gmail.com>
2024-04-25 17:39:07 -07:00
Erick Friis
58ba508ef3 core[patch]: deprecate hwchase17/langchain-hub, address path traversal (#18600)
Deprecates the old langchain-hub repository. Does *not* deprecate the
new https://smith.langchain.com/hub

@PinkDraconian has correctly raised that in the event someone is loading
unsanitized user input into the `try_load_from_hub` function, they have
the ability to load files from other locations in github than the
hwchase17/langchain-hub repository.

This PR adds some more path checking to that function and deprecates the
functionality in favor of the hub built into LangSmith.
2024-04-25 17:39:07 -07:00
Reuben Zotz-Wilson
5c7a3d7e1c community:update telegram notebook (#18569)
**Description:** 
modified the user_name to username to conform with the expected inputs
to TelegramChatApiLoader

**Issue:**
Current code fails in langchain-community 0.0.24 
<loader = TelegramChatApiLoader(
    chat_entity="<CHAT_URL>",  # recommended to use Entity here
    api_hash="<API HASH >",
    api_id="<API_ID>",
    user_name="",  # needed only for caching the session.
)>
2024-04-25 17:39:07 -07:00
Jib
8553283ac9 langchain-mongodb: add unit tests for MongoDBChatMessageHistory (#18599)
## Description
Adding in Unit Test variation for `MongoDBChatMessageHistory` package
Follow-up to #18590 

- [x] **Add tests and docs**: Unit test is what's being added
  

- [x] **Lint and test**: Run `make format`, `make lint` and `make test`
from the root of the package(s) you've modified. See contribution
guidelines for more: https://python.langchain.com/docs/contributing/
2024-04-25 17:39:07 -07:00
Erick Friis
0c843f011b airbyte[patch]: release 0.1.1, python 3.9 compat (#18597) 2024-04-25 17:39:07 -07:00
Jib
19270afabd mongodb[patch]: Migrate MongoDBChatMessageHistory (#18590)
## **Description** 
Migrate the `MongoDBChatMessageHistory` to the managed
`langchain-mongodb` partner-package
## **Dependencies**
None
## **Twitter handle**
@mongodb

## **tests and docs**
- [x] Migrate existing integration test
- [x ]~ Convert existing integration test to a unit test~ Creation is
out of scope for this ticket
- [x ] ~Considering delaying work until #17470 merges to leverage the
`MockCollection` object. ~
- [x] **Lint and test**: Run `make format`, `make lint` and `make test`
from the root of the package(s) you've modified. See contribution
guidelines for more: https://python.langchain.com/docs/contributing/

---------

Co-authored-by: Erick Friis <erick@langchain.dev>
2024-04-25 17:39:07 -07:00
Jib
0480b197bb mongodb[minor]: Add MongoDB LLM Cache (#17470)
# Description

- **Description:** Adding MongoDB LLM Caching Layer abstraction
- **Issue:** N/A
- **Dependencies:** None
- **Twitter handle:** @mongodb

Checklist:

- [x] PR title: Please title your PR "package: description", where
"package" is whichever of langchain, community, core, experimental, etc.
is being modified. Use "docs: ..." for purely docs changes, "templates:
..." for template changes, "infra: ..." for CI changes.
  - Example: "community: add foobar LLM"
- [x] PR Message (above)
- [x] Pass lint and test: Run `make format`, `make lint` and `make test`
from the root of the package(s) you've modified to check that you're
passing lint and testing. See contribution guidelines for more
information on how to write/run tests, lint, etc:
https://python.langchain.com/docs/contributing/
- [ ] Add tests and docs: If you're adding a new integration, please
include
1. a test for the integration, preferably unit tests that do not rely on
network access,
2. an example notebook showing its use. It lives in
`docs/docs/integrations` directory.

Additional guidelines:
- Make sure optional dependencies are imported within a function.
- Please do not add dependencies to pyproject.toml files (even optional
ones) unless they are required for unit tests.
- Most PRs should not touch more than one package.
- Changes should be backwards compatible.
- If you are adding something to community, do not re-import it in
langchain.

If no one reviews your PR within a few days, please @-mention one of
@baskaryan, @efriis, @eyurtsev, @hwchase17.

---------

Co-authored-by: Jib <jib@byblack.us>
2024-04-25 17:39:07 -07:00
Tomaz Bratanic
e91678fcce Update link in neo4j semantic ollama templates (#18574) 2024-04-25 17:39:07 -07:00
Tomaz Bratanic
ab3abc50ff Add precedence for input params over env variables in neo4j integration (#18581)
input parameters take precedence over env variables
2024-04-25 17:39:07 -07:00
Christophe Bornet
e889de8a2e community: Implement lazy_load() for GithubFileLoader (#18584) 2024-04-25 17:39:07 -07:00
Leonid Kuligin
58b99b1593 marked MatchingEngine as deprecated (#18585)
Thank you for contributing to LangChain!

- [ ] **PR title**: "community: deprecate vectorstores.MatchingEngine"


- [ ] **PR message**: 
- **Description:** announced a deprecation since this integration has
been moved to langchain_google_vertexai
2024-04-25 17:39:07 -07:00
Erick Friis
acad2ad1d0 docs: anthropic multimodal (#18586) 2024-04-25 17:39:07 -07:00
Erick Friis
ba1250a910 anthropic[minor]: add tool calling (#18554) 2024-04-25 17:39:07 -07:00
Bagatur
71a34fde5d langchain[patch]: Release 0.1.11 (#18558) 2024-04-25 17:39:07 -07:00
Erick Friis
dafa800279 anthropic[patch]: model type string (#18510) 2024-04-25 17:39:07 -07:00
Akash A Desai
1f7e25cd1d templates: fix rag-lancedb template (#18551) 2024-04-25 17:39:07 -07:00
Erick Friis
aa3a2694ce anthropic[patch]: multimodal (#18517)
- anthropic[minor]: claude 3
- x
- x

---------

Co-authored-by: William FH <13333726+hinthornw@users.noreply.github.com>
2024-04-25 17:39:07 -07:00
Erick Friis
998736ca7c community[patch]: deprecate community fireworks (#18544) 2024-04-25 17:39:07 -07:00
William FH
74448a827b Evals wording (#18542) 2024-04-25 17:39:07 -07:00
Brace Sproul
faaf044831 docs[minor]: Add thumbs up/down to all docs pages (#18526) 2024-04-25 17:39:07 -07:00
Erick Friis
4d036305fb docs: update stack graphic (#18532) 2024-04-25 17:39:07 -07:00
Bagatur
42b963a329 core[patch]: Release 0.1.29 (#18530) 2024-04-25 17:39:07 -07:00
William FH
78d744a1c7 [Evals] Support list examples by dataset version tag (#18534)
previously only supported by timestamp
2024-04-25 17:39:07 -07:00
Lance Martin
0056e224d2 RAPTOR (#18467)
Cookbook for RAPTOR paper
2024-04-25 17:39:07 -07:00
aditya thomas
281304e9e8 docs: update documentation of stackexchange component (#18486)
**Description:** Update documentation of the StackExchange component
**Issue:** None
**Dependencies:** None
2024-04-25 17:39:07 -07:00
aditya thomas
9b41884ed9 docs: update to docstrings of ChatAnthropic class (#18493)
**Description:** Update docstrings of ChatAnthropic class
**Issue:** Change to ChatAnthropic from ChatAnthropicMessages
**Dependencies:** None
**Lint and test**:  `make format`, `make lint` and `make test` passed
2024-04-25 17:39:07 -07:00
Martin Kolb
e42a65ac44 docs: Improved notebook for vector store "HANA Cloud" (#18496)
- **Description:**
This PR fixes some issues in the Jupyter notebook for the VectorStore
"SAP HANA Cloud Vector Engine":
    * Slight textual adaptations
    * Fix of wrong column name VEC_META (was: VEC_METADATA)

  - **Issue:** N/A
  - **Dependencies:** no new dependecies added
  - **Twitter handle:** @sapopensource

path to notebook:
`docs/docs/integrations/vectorstores/hanavector.ipynb`
2024-04-25 17:39:07 -07:00
standby24x7
ce0e506249 docs: Update function "run" to "invoke" (#18499)
Currently llm_checker.ipynb uses a function "run".
Update to "invoke" to avoid following warning.

LangChainDeprecationWarning: The function `run` was deprecated in
LangChain 0.1.0
and will be removed in 0.2.0. Use invoke instead.

Signed-off-by: Masanari Iida <standby24x7@gmail.com>
2024-04-25 17:39:07 -07:00
standby24x7
95708c2a9f docs: Update function "run" to "invoke" in llm_math.ipynb (#18505)
This patch updates function "run" to "invoke".
Without this patch you see following warning.

LangChainDeprecationWarning: The function `run` was deprecated in
LangChain 0.1.0 and will be removed in 0.2.0. Use invoke instead.

Signed-off-by: Masanari Iida <standby24x7@gmail.com>
2024-04-25 17:39:07 -07:00
Bagatur
c38c2c4b8b docs: quickstart models (#18511) 2024-04-25 17:39:07 -07:00
aditya thomas
d0f89249b1 docs: add groq to list of providers (#18503)
**Description:** Add Groq to the list of providers
**Issue:** None
**Dependencies:** None
2024-04-25 17:39:07 -07:00
Erick Friis
63aa1f4395 anthropic[minor]: claude 3 (#18508) 2024-04-25 17:39:07 -07:00
William De Vena
0966c2e9cc Docs: Updated callbacks/index.mdx adding example on invoke method (#18403)
## PR title
Docs: Updated callbacks/index.mdx adding example on runnable methods

## PR message
- **Description:** Updated callbacks/index.mdx adding an example on how
to pass callbacks to the runnable methods (invoke, batch, ...)
- **Issue:** #16379
- **Dependencies:** None
2024-04-25 17:39:07 -07:00
Jacob Lee
9e9fc7751d 👥 Update LangChain people data (#18473)
👥 Update LangChain people data

Co-authored-by: github-actions <github-actions@github.com>
2024-04-25 17:39:07 -07:00
William FH
f9ec4e16e0 Improve notebook wording (#18472) 2024-04-25 17:39:06 -07:00
William FH
ab46922d40 Evaluate on Version (#18471) 2024-04-25 17:39:06 -07:00
William FH
9a21c7cf94 Update Notebook Image (#18470) 2024-04-25 17:39:06 -07:00
Harrison Chase
fae380af72 [Evals] Session-level feedback (#18463)
Co-authored-by: William Fu-Hinthorn <13333726+hinthornw@users.noreply.github.com>
2024-04-25 17:39:06 -07:00