Rajendra Kadam a6add89bd4 community[minor]: [PebbloSafeLoader] Implement content-size-based batching (#24871) ...

- **Title:** [PebbloSafeLoader] Implement content-size-based batching in
the classification flow(loader/doc API)
- **Description:** 
- Implemented content-size-based batching in the loader/doc API, set to
100KB with no external configuration option, intentionally hard-coded to
prevent timeouts.
    - Remove unused field(pb_id) from doc_metadata
- **Issue:** NA
- **Dependencies:** NA
- **Add tests and docs:** Updated

2024-07-31 09:10:28 -04:00

..

__init__.py

community[major], experimental[patch]: Remove Python REPL from community (#22904)

2024-06-14 17:53:29 +00:00

alpha_vantage.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

anthropic.py

…

apify.py

community[patch]: root validator set explicit pre=False or pre=True (#23764)

2024-07-02 09:42:05 -04:00

arcee.py

community[patch]: root validator set explicit pre=False or pre=True (#23764)

2024-07-02 09:42:05 -04:00

arxiv.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

asknews.py

community[patch]: root validator set explicit pre=False or pre=True (#23764)

2024-07-02 09:42:05 -04:00

astradb.py

community[patch]: docstrings update (#20301)

2024-04-11 16:23:27 -04:00

awslambda.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

bibtex.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

bing_search.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

brave_search.py

Brave Search: Enhance search result details with extra snippets (#19209)

2024-07-30 15:29:38 +00:00

cassandra_database.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

cassandra.py

community: docstrings (#23202)

2024-06-20 11:08:13 -04:00

clickup.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

dalle_image_generator.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

dataforseo_api_search.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

dataherald.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

dria_index.py

community[minor]: Add Dria retriever (#17098)

2024-04-01 12:04:19 -07:00

duckduckgo_search.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

github.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

gitlab.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

golden_query.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

google_finance.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

google_jobs.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

google_lens.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

google_places_api.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

google_scholar.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

google_search.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

google_serper.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

google_trends.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

graphql.py

…

infobip.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

jira.py

community: add support for 'cloud' parameter in JiraAPIWrapper (#23057)

2024-07-05 15:11:10 +00:00

max_compute.py

…

merriam_webster.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

metaphor_search.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

mojeek_search.py

community[patch]: Add missing type annotations (#22758)

2024-06-10 16:59:28 -04:00

nasa.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

nvidia_riva.py

…

opaqueprompts.py

…

openapi.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

openweathermap.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

oracleai.py

community[minor]: Oraclevs integration (#21123)

2024-05-04 03:15:35 +00:00

outline.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

passio_nutrition_ai.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

pebblo.py

community[minor]: [PebbloSafeLoader] Implement content-size-based batching (#24871)

2024-07-31 09:10:28 -04:00

polygon.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

portkey.py

…

powerbi.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

pubmed.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

python.py

community[major], experimental[patch]: Remove Python REPL from community (#22904)

2024-06-14 17:53:29 +00:00

reddit_search.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

redis.py

community[patch]: upgrade to recent version of mypy (#21616)

2024-05-13 14:55:07 -04:00

rememberizer.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

requests.py

community[patch]: Fix invalid iohttp verify parameter (#24655)

2024-07-25 11:09:21 -04:00

scenexplain.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

searchapi.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

searx_search.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

semanticscholar.py

community[patch]: update typo document content returned from semanticscholar (#24175)

2024-07-12 15:40:47 +00:00

serpapi.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

spark_sql.py

community[minor]: import fix (#20995)

2024-04-29 10:32:50 -04:00

sql_database.py

infra: add min version testing to pr test flow (#24358)

2024-07-19 22:03:19 +00:00

stackexchange.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

steam.py

community[patch]: Add linter to catch @root_validator (#24070)

2024-07-10 14:51:03 +00:00

tavily_search.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

tensorflow_datasets.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

twilio.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

vertexai.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

wikidata.py

community[patch]: update @root_validator in utilities namespace (#23768)

2024-07-02 14:33:01 +00:00

wikipedia.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

wolfram_alpha.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00

you.py

community[patch]: Add linter to catch @root_validator (#24070)

2024-07-10 14:51:03 +00:00

zapier.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00