Skip to main content
GPTRouter 是一个开源 LLM API 网关，为 30 多个 LLM、视觉和图像模型提供统一 API，具备基于可用性和延迟的智能故障转移、自动重试和流式传输功能。 本笔记本介绍如何开始使用 LangChain + GPTRouter I/O 库。
  • 设置 GPT_ROUTER_API_KEY 环境变量
  • 或使用 gpt_router_api_key 关键字参数
pip install -qU  GPTRouter

from langchain_community.chat_models import GPTRouter
from langchain_community.chat_models.gpt_router import GPTRouterModel
from langchain.messages import HumanMessage

anthropic_claude = GPTRouterModel(name="claude-instant-1.2", provider_name="anthropic")

chat = GPTRouter(models_priority_list=[anthropic_claude])

messages = [
    HumanMessage(
        content="Translate this sentence from English to French. I love programming."
    )
]
chat(messages)

AIMessage(content=" J'aime programmer.")

​
GPTRouter 同样支持异步和流式功能

from langchain_core.callbacks import CallbackManager, StreamingStdOutCallbackHandler

await chat.agenerate([messages])

LLMResult(generations=[[ChatGeneration(text=" J'aime programmer.", generation_info={'finish_reason': 'stop_sequence'}, message=AIMessage(content=" J'aime programmer."))]], llm_output={}, run=[RunInfo(run_id=UUID('9885f27f-c35a-4434-9f37-c254259762a5'))])

chat = GPTRouter(
    models_priority_list=[anthropic_claude],
    streaming=True,
    verbose=True,
    callback_manager=CallbackManager([StreamingStdOutCallbackHandler()]),
)
chat(messages)

 J'aime programmer.

AIMessage(content=" J'aime programmer.")
Edit this page on GitHub or file an issue.
Connect these docs to Claude, VSCode, and more via MCP for real-time answers.