mirror of
https://github.com/hwchase17/langchain.git
synced 2025-08-09 21:08:59 +00:00
dee72c46c1
In collaboration with @rlouf I build an [outlines](https://dottxt-ai.github.io/outlines/latest/) integration for langchain! I think this is really useful for doing any type of structured output locally. [Dottxt](https://dottxt.co) spend alot of work optimising this process at a lower level ([outlines-core](https://pypi.org/project/outlines-core/0.1.14/) written in rust) so I think this is a better alternative over all current approaches in langchain to do structured output. It also implements the `.with_structured_output` method so it should be a drop in replacement for a lot of applications. The integration includes: - **Outlines LLM class** - **ChatOutlines class** - **Tutorial Cookbooks** - **Documentation Page** - **Validation and error messages** - **Exposes Outlines Structured output features** - **Support for multiple backends** - **Integration and Unit Tests** Dependencies: `outlines` + additional (depending on backend used) I am not sure if the unit-tests comply with all requirements, if not I suggest to just remove them since I don't see a useful way to do it differently. ### Quick overview: Chat Models: <img width="698" alt="image" src="https://github.com/user-attachments/assets/05a499b9-858c-4397-a9ff-165c2b3e7acc"> Structured Output: <img width="955" alt="image" src="https://github.com/user-attachments/assets/b9fcac11-d3e5-4698-b1ae-8c4cb3d54c45"> --------- Co-authored-by: Vadym Barda <vadym@langchain.dev> |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| test_ai21.py | ||
| test_aleph_alpha.py | ||
| test_anthropic.py | ||
| test_anyscale.py | ||
| test_arcee.py | ||
| test_aviary.py | ||
| test_azure_openai.py | ||
| test_azureml_endpoint.py | ||
| test_baichuan.py | ||
| test_banana.py | ||
| test_baseten.py | ||
| test_beam.py | ||
| test_bedrock.py | ||
| test_bigdl_llm.py | ||
| test_bittensor.py | ||
| test_cerebriumai.py | ||
| test_chatglm.py | ||
| test_clarifai.py | ||
| test_cloudflare_workersai.py | ||
| test_cohere.py | ||
| test_confident.py | ||
| test_ctransformers.py | ||
| test_deepinfra.py | ||
| test_deepsparse.py | ||
| test_edenai.py | ||
| test_fireworks.py | ||
| test_forefrontai.py | ||
| test_friendli.py | ||
| test_google_palm.py | ||
| test_gooseai.py | ||
| test_gpt4all.py | ||
| test_gradient_ai.py | ||
| test_huggingface_endpoint.py | ||
| test_huggingface_hub.py | ||
| test_huggingface_pipeline.py | ||
| test_huggingface_text_gen_inference.py | ||
| test_ipex_llm.py | ||
| test_konko.py | ||
| test_layerup_security.py | ||
| test_llamacpp.py | ||
| test_llamafile.py | ||
| test_manifest.py | ||
| test_minimax.py | ||
| test_mlx_pipeline.py | ||
| test_modal.py | ||
| test_mosaicml.py | ||
| test_nlpcloud.py | ||
| test_octoai_endpoint.py | ||
| test_opaqueprompts.py | ||
| test_openai.py | ||
| test_openllm.py | ||
| test_openlm.py | ||
| test_outlines.py | ||
| test_pai_eas_endpoint.py | ||
| test_petals.py | ||
| test_pipelineai.py | ||
| test_predictionguard.py | ||
| test_promptlayer_openai.py | ||
| test_propmptlayer_openai_chat.py | ||
| test_qianfan_endpoint.py | ||
| test_replicate.py | ||
| test_rwkv.py | ||
| test_sambanova.py | ||
| test_self_hosted_llm.py | ||
| test_sparkllm.py | ||
| test_stochasticai.py | ||
| test_symblai_nebula.py | ||
| test_titan_takeoff.py | ||
| test_together.py | ||
| test_tongyi.py | ||
| test_vertexai.py | ||
| test_volcengine_maas.py | ||
| test_watsonxllm.py | ||
| test_weight_only_quantization.py | ||
| test_writer.py | ||
| test_xinference.py | ||
| test_yuan2.py | ||
| utils.py | ||