langchain/docs/extras/integrations/llms
Blake (Yung Cher Ho) f4bed8a04c
Takeoff baseurl support (#10091)
## Description
This PR introduces a minor change to the TitanTakeoff integration. 
Instead of specifying a port on localhost, this PR will allow users to
specify a baseURL instead. This will allow users to use the integration
if they have TitanTakeoff deployed externally (not on localhost). This
removes the hardcoded reference to localhost "http://localhost:{port}".

### Info about Titan Takeoff
Titan Takeoff is an inference server created by
[TitanML](https://www.titanml.co/) that allows you to deploy large
language models locally on your hardware in a single command. Most
generative model architectures are included, such as Falcon, Llama 2,
GPT2, T5 and many more.

Read more about Titan Takeoff here:
-
[Blog](https://medium.com/@TitanML/introducing-titan-takeoff-6c30e55a8e1e)
- [Docs](https://docs.titanml.co/docs/titan-takeoff/getting-started)

### Dependencies
No new dependencies are introduced. However, users will need to install
the titan-iris package in their local environment and start the Titan
Takeoff inferencing server in order to use the Titan Takeoff
integration.

Thanks for your help and please let me know if you have any questions.
cc: @hwchase17 @baskaryan

---------

Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>
2023-09-03 14:45:59 -07:00
..
ai21.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
aleph_alpha.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
amazon_api_gateway.ipynb 📖 docs: fixed integration/llms navbar (#9277) 2023-09-01 15:30:37 -07:00
anyscale.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
azure_ml.ipynb 📖 docs: fixed integration/llms navbar (#9277) 2023-09-01 15:30:37 -07:00
azure_openai.ipynb 📖 docs: fixed integration/llms navbar (#9277) 2023-09-01 15:30:37 -07:00
banana.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
baseten.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
beam.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
bedrock.ipynb Bedrock embeddings async methods (#9024) 2023-08-10 14:21:03 -07:00
bittensor.ipynb Changed the NIBittensorLLM API URL to the correct one (#9419) 2023-08-20 16:25:19 -07:00
cerebriumai.ipynb 📖 docs: fixed integration/llms navbar (#9277) 2023-09-01 15:30:37 -07:00
chatglm.ipynb Change with_history option to False for ChatGLM by default (#8076) 2023-07-24 15:46:02 -07:00
clarifai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
cohere.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
ctransformers.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
databricks.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
deepinfra.ipynb 📖 docs: fixed integration/llms navbar (#9277) 2023-09-01 15:30:37 -07:00
deepsparse.ipynb Adds DeepSparse as an LLM (#9184) 2023-08-13 22:35:58 -07:00
edenai.ipynb rm base64 images from docs (#10110) 2023-09-01 15:15:12 -07:00
fireworks.ipynb 📖 docs: fixed integration/llms navbar (#9277) 2023-09-01 15:30:37 -07:00
forefrontai.ipynb 📖 docs: fixed integration/llms navbar (#9277) 2023-09-01 15:30:37 -07:00
google_vertex_ai_palm.ipynb added support for inference from Model Garden (#9367) 2023-09-01 15:58:21 -07:00
gooseai.ipynb 📖 docs: fixed integration/llms navbar (#9277) 2023-09-01 15:30:37 -07:00
gpt4all.ipynb Updates to Nomic Atlas and GPT4All documentation (#9414) 2023-08-23 17:49:44 -07:00
huggingface_hub.ipynb Qwen model example (#9516) 2023-08-20 17:21:45 -07:00
huggingface_pipelines.ipynb Fix imports in notebook (#9458) 2023-08-18 10:08:47 -07:00
huggingface_textgen_inference.ipynb Fix typo in huggingface_textgen_inference.ipynb (#9313) 2023-08-16 16:22:21 -07:00
index.mdx mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
jsonformer_experimental.ipynb Wfh/ref links (#8454) 2023-07-29 08:44:32 -07:00
koboldai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
llamacpp.ipynb Add instructions for GGUF (#9874) 2023-08-28 12:56:46 -07:00
llm_caching.ipynb docs: fix for title of llm_caching nb (#9891) 2023-08-28 18:34:04 -07:00
manifest.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
minimax.ipynb Add Minimax llm model to langchain (#7645) 2023-07-27 22:53:23 -07:00
modal.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
mosaicml.ipynb Update Mosaic endpoint input/output api (#7391) 2023-08-24 22:13:17 -07:00
nlpcloud.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
octoai.ipynb 📖 docs: fixed integration/llms navbar (#9277) 2023-09-01 15:30:37 -07:00
ollama.ipynb Update Ollama docs (#9220) 2023-08-14 13:56:16 -07:00
opaqueprompts.ipynb refactor: rename to OpaquePrompts (#10013) 2023-08-31 12:21:24 -07:00
openai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
openllm.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
openlm.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
petals.ipynb 📖 docs: fixed integration/llms navbar (#9277) 2023-09-01 15:30:37 -07:00
pipelineai.ipynb 📖 docs: fixed integration/llms navbar (#9277) 2023-09-01 15:30:37 -07:00
predibase.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
predictionguard.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
promptlayer_openai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
rellm_experimental.ipynb Wfh/ref links (#8454) 2023-07-29 08:44:32 -07:00
replicate.ipynb rm base64 images from docs (#10110) 2023-09-01 15:15:12 -07:00
runhouse.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
sagemaker.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
stochasticai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
symblai_nebula.ipynb Improvements in Nebula LLM (#9226) 2023-08-15 15:33:07 -07:00
textgen.ipynb feat(llms): add streaming support to textgen (#9295) 2023-08-21 07:39:14 -07:00
titan_takeoff.ipynb Takeoff baseurl support (#10091) 2023-09-03 14:45:59 -07:00
tongyi.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
vllm.ipynb feat(llms): support vLLM's OpenAI-compatible server (#9179) 2023-08-13 23:03:05 -07:00
writer.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
xinference.ipynb FEAT: Integrate Xinference LLMs and Embeddings (#8171) 2023-07-27 21:23:19 -07:00