Rajendra Kadam a6add89bd4 community[minor]: [PebbloSafeLoader] Implement content-size-based batching (#24871) ...

- **Title:** [PebbloSafeLoader] Implement content-size-based batching in
the classification flow(loader/doc API)
- **Description:** 
- Implemented content-size-based batching in the loader/doc API, set to
100KB with no external configuration option, intentionally hard-coded to
prevent timeouts.
    - Remove unused field(pb_id) from doc_metadata
- **Issue:** NA
- **Dependencies:** NA
- **Add tests and docs:** Updated

2024-07-31 09:10:28 -04:00

..

examples

…

integration_tests

community: replace it with Tencent Cloud SDK (#24172)

2024-07-31 09:05:38 -04:00

unit_tests

community[minor]: [PebbloSafeLoader] Implement content-size-based batching (#24871)

2024-07-31 09:10:28 -04:00

__init__.py

…

data.py

infra: update mypy 1.10, ruff 0.5 (#23721)

2024-07-03 10:33:27 -07:00