langchain/docs/extras/integrations/llms
Blake (Yung Cher Ho) 8d351bfc20
Takeoff integration (#9045)
## Description:
This PR adds the Titan Takeoff Server to the available LLMs in
LangChain.

Titan Takeoff is an inference server created by
[TitanML](https://www.titanml.co/) that allows you to deploy large
language models locally on your hardware in a single command. Most
generative model architectures are included, such as Falcon, Llama 2,
GPT2, T5 and many more.

Read more about Titan Takeoff here:
-
[Blog](https://medium.com/@TitanML/introducing-titan-takeoff-6c30e55a8e1e)
- [Docs](https://docs.titanml.co/docs/titan-takeoff/getting-started)

#### Testing
As Titan Takeoff runs locally on port 8000 by default, no network access
is needed. Responses are mocked for testing.

- [x] Make Lint
- [x] Make Format
- [x] Make Test

#### Dependencies
No new dependencies are introduced. However, users will need to install
the titan-iris package in their local environment and start the Titan
Takeoff inferencing server in order to use the Titan Takeoff
integration.

Thanks for your help and please let me know if you have any questions.

cc: @hwchase17 @baskaryan
2023-08-10 10:56:06 -07:00
..
ai21.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
aleph_alpha.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
amazon_api_gateway_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
anyscale.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
azure_openai_example.ipynb Update Integrations links (#8206) 2023-07-24 21:20:32 -07:00
azureml_endpoint_example.ipynb Add LLaMa Formatter and AzureML Chat Endpoint (#8382) 2023-07-31 16:26:25 -07:00
banana.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
baseten.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
beam.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
bedrock.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
cerebriumai_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
chatglm.ipynb Change with_history option to False for ChatGLM by default (#8076) 2023-07-24 15:46:02 -07:00
clarifai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
cohere.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
ctransformers.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
databricks.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
deepinfra_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
edenai.ipynb Bagatur/eden llm (#8670) 2023-08-03 10:24:51 -07:00
Fireworks.ipynb Updates fireworks (#8765) 2023-08-04 10:32:22 -07:00
forefrontai_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
google_vertex_ai_palm.ipynb Updated docs on Vertex AI going GA (#8531) 2023-07-31 17:15:04 -07:00
gooseai_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
gpt4all.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
huggingface_hub.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
huggingface_pipelines.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
huggingface_textgen_inference.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
index.mdx mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
jsonformer_experimental.ipynb Wfh/ref links (#8454) 2023-07-29 08:44:32 -07:00
koboldai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
llamacpp.ipynb docs: llamacpp minor fixes (#8738) 2023-08-04 14:19:43 -07:00
llm_caching.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
manifest.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
minimax.ipynb Add Minimax llm model to langchain (#7645) 2023-07-27 22:53:23 -07:00
modal.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
mosaicml.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
nlpcloud.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
octoai.ipynb Add api cross ref linking (#8275) 2023-07-26 12:38:58 -07:00
ollama.ipynb Adds Ollama as an LLM (#8829) 2023-08-07 21:19:22 -07:00
openai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
openllm.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
openlm.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
petals_example.ipynb fix(petals) allows to run models that aren't Bloom (Support for LLama and newer models) (#8356) 2023-07-27 18:01:04 -07:00
pipelineai_example.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
predibase.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
predictionguard.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
promptlayer_openai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
rellm_experimental.ipynb Wfh/ref links (#8454) 2023-07-29 08:44:32 -07:00
replicate.ipynb Added stop sequence support to replicate (#8107) 2023-07-24 17:34:13 -07:00
runhouse.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
sagemaker.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
stochasticai.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
symblai_nebula.ipynb Fixes to the Nebula LLM Integration (#8918) 2023-08-08 10:04:43 -07:00
textgen.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
titan_takeoff.ipynb Takeoff integration (#9045) 2023-08-10 10:56:06 -07:00
tongyi.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
vllm.ipynb feat(llms): add support for vLLM (#8806) 2023-08-07 07:32:02 -07:00
writer.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
xinference.ipynb FEAT: Integrate Xinference LLMs and Embeddings (#8171) 2023-07-27 21:23:19 -07:00