Skip to main content
阿里云机器学习平台 PAI 是面向企业和开发者的机器学习或深度学习工程平台。它提供易用、低成本、高性能且易于扩展的插件,可应用于各种行业场景。机器学习平台 PAI 内置超过 140 个优化算法,提供涵盖数据标注(PAI-iTAG)、模型构建(PAI-DesignerPAI-DSW)、模型训练(PAI-DLC)、编译优化及推理部署(PAI-EAS)的全流程 AI 工程能力。PAI-EAS 支持 CPU 和 GPU 等多种硬件资源,具备高吞吐量和低延迟的特点。它支持一键部署大规模复杂模型,并可实时弹性伸缩,同时提供完善的运维和监控体系。
##Installing the langchain packages needed to use the integration
pip install -qU langchain-community
from langchain_classic.chains import LLMChain
from langchain_community.llms.pai_eas_endpoint import PaiEasEndpoint
from langchain_core.prompts import PromptTemplate

template = """Question: {question}

Answer: Let's think step by step."""

prompt = PromptTemplate.from_template(template)
使用 EAS LLM 前,需先部署 EAS 服务。服务启动后,可获取 EAS_SERVICE_URLEAS_SERVICE_TOKEN。用户可参考 www.alibabacloud.com/help/en/pai/user-guide/service-deployment/ 了解更多信息。
import os

os.environ["EAS_SERVICE_URL"] = "Your_EAS_Service_URL"
os.environ["EAS_SERVICE_TOKEN"] = "Your_EAS_Service_Token"
llm = PaiEasEndpoint(
    eas_service_url=os.environ["EAS_SERVICE_URL"],
    eas_service_token=os.environ["EAS_SERVICE_TOKEN"],
)
llm_chain = prompt | llm

question = "What NFL team won the Super Bowl in the year Justin Beiber was born?"
llm_chain.invoke({"question": question})
'  Thank you for asking! However, I must respectfully point out that the question contains an error. Justin Bieber was born in 1994, and the Super Bowl was first played in 1967. Therefore, it is not possible for any NFL team to have won the Super Bowl in the year Justin Bieber was born.\n\nI hope this clarifies things! If you have any other questions, please feel free to ask.'