{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Baichuan LLM\n", "Baichuan Inc. (https://www.baichuan-ai.com/) is a Chinese startup in the era of AGI, dedicated to addressing fundamental human needs: Efficiency, Health, and Happiness." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Prerequisite\n", "An API key is required to access Baichuan LLM API. Visit https://platform.baichuan-ai.com/ to get your API key." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Use Baichuan LLM" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "import os\n", "\n", "os.environ[\"BAICHUAN_API_KEY\"] = \"YOUR_API_KEY\"" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "from langchain_community.llms import BaichuanLLM\n", "\n", "# Load the model\n", "llm = BaichuanLLM()\n", "\n", "res = llm(\"What's your name?\")\n", "print(res)" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "res = llm.generate(prompts=[\"你好!\"])\n", "res" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "for res in llm.stream(\"Who won the second world war?\"):\n", " print(res)" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "import asyncio\n", "\n", "\n", "async def run_aio_stream():\n", " async for res in llm.astream(\"Write a poem about the sun.\"):\n", " print(res)\n", "\n", "\n", "asyncio.run(run_aio_stream())" ] } ], "metadata": { "language_info": { "name": "python" } }, "nbformat": 4, "nbformat_minor": 2 }