mirror of
https://github.com/hwchase17/langchain.git
synced 2025-05-28 02:29:17 +00:00
Running `GPT4All` per the [docs](https://python.langchain.com/docs/modules/model_io/models/llms/integrations/gpt4all), I see: ``` $ from langchain.llms import GPT4All $ model = GPT4All(model=local_path) $ model("The capital of France is ", max_tokens=10) TypeError: generate() got an unexpected keyword argument 'n_ctx' ``` It appears `n_ctx` is [no longer a supported param](https://docs.gpt4all.io/gpt4all_python.html#gpt4all.gpt4all.GPT4All.generate) in the GPT4All API from https://github.com/nomic-ai/gpt4all/pull/1090. It now uses `max_tokens`, so I set this. And I also set other defaults used in GPT4All client [here](https://github.com/nomic-ai/gpt4all/blob/main/gpt4all-bindings/python/gpt4all/gpt4all.py). Confirm it now works: ``` $ from langchain.llms import GPT4All $ model = GPT4All(model=local_path) $ model("The capital of France is ", max_tokens=10) < Model logging > "....Paris." ``` --------- Co-authored-by: R. Lance Martin <rlm@Rs-MacBook-Pro.local> |
||
---|---|---|
.. | ||
ai21.ipynb | ||
aleph_alpha.ipynb | ||
amazon_api_gateway_example.ipynb | ||
anyscale.ipynb | ||
azure_openai_example.ipynb | ||
azureml_endpoint_example.ipynb | ||
banana.ipynb | ||
baseten.ipynb | ||
beam.ipynb | ||
bedrock.ipynb | ||
cerebriumai_example.ipynb | ||
clarifai.ipynb | ||
cohere.ipynb | ||
ctransformers.ipynb | ||
databricks.ipynb | ||
deepinfra_example.ipynb | ||
forefrontai_example.ipynb | ||
google_vertex_ai_palm.ipynb | ||
gooseai_example.ipynb | ||
gpt4all.ipynb | ||
huggingface_hub.ipynb | ||
huggingface_pipelines.ipynb | ||
huggingface_textgen_inference.ipynb | ||
jsonformer_experimental.ipynb | ||
llamacpp.ipynb | ||
llm_caching.ipynb | ||
manifest.ipynb | ||
modal.ipynb | ||
mosaicml.ipynb | ||
nlpcloud.ipynb | ||
octoai.ipynb | ||
openai.ipynb | ||
openllm.ipynb | ||
openlm.ipynb | ||
petals_example.ipynb | ||
pipelineai_example.ipynb | ||
predictionguard.ipynb | ||
promptlayer_openai.ipynb | ||
rellm_experimental.ipynb | ||
replicate.ipynb | ||
runhouse.ipynb | ||
sagemaker.ipynb | ||
stochasticai.ipynb | ||
textgen.ipynb | ||
writer.ipynb |