Zander Chase 785502edb3 Add 'get_token_ids' method (#4784) ...

Let user inspect the token ids in addition to getting th enumber of tokens

---------

Co-authored-by: Zach Schillaci <40636930+zachschillaci27@users.noreply.github.com>

2023-05-22 13:17:26 +00:00

..

agent

power bi api wrapper integration tests & bug fix (#4983)

2023-05-19 11:25:52 -04:00

cache

Optimize the initialization method of GPTCache (#4522)

2023-05-11 16:15:23 -07:00

callbacks

add tracing v2 env var (#4465)

2023-05-10 11:08:29 -07:00

chains

Callbacks Refactor [base] (#3256)

2023-04-30 11:14:09 -07:00

chat_models

add alias for model (#4553)

2023-05-18 09:12:23 -07:00

document_loaders

feat: batch multiple files in a single Unstructured API request (#4525)

2023-05-21 20:48:20 -07:00

embeddings

Dev2049/hf emb encode kwargs (#3925)

2023-05-01 20:27:41 -07:00

examples

fix(document_loaders/telegram): fix pandas calls + add tests (#4806)

2023-05-16 14:35:25 -07:00

llms

Add 'get_token_ids' method (#4784)

2023-05-22 13:17:26 +00:00

memory

Cassandra support for chat history (#4378) (#4764)

2023-05-15 23:43:09 -07:00

prompts

Cleanup integration test dir (#3308)

2023-04-21 09:44:09 -07:00

retrievers

Remove unnecessary comment (#4845)

2023-05-17 11:53:03 -04:00

utilities

Fix graphql tool (#4984)

2023-05-19 15:27:50 -07:00

vectorstores

Adds 'IN' metadata filter for pgvector for checking set presence (#4982)

2023-05-19 13:53:23 -07:00

__init__.py

initial commit

2022-10-24 14:51:15 -07:00

.env.example

power bi api wrapper integration tests & bug fix (#4983)

2023-05-19 11:25:52 -04:00

conftest.py

feat: improve pinecone tests (#2806)

2023-04-13 21:49:31 -07:00

test_document_transformers.py

Contextual compression retriever (#2915)

2023-04-20 17:01:14 -07:00

test_nlp_text_splitters.py

OptimizedPrompt -- k-shot example choice backed by semantic search (#91)

2022-11-09 21:15:42 -08:00

test_pdf_pagesplitter.py

cleanup: unify 3 different pdf loaders, rename PagedPDFSplitter (#1615)

2023-03-13 23:06:50 -07:00

test_schema.py

Add 'get_token_ids' method (#4784)

2023-05-22 13:17:26 +00:00

test_text_splitter.py

Fix TextSplitter.from_tiktoken(#4361)

2023-05-08 16:36:38 -07:00