Skip to main content
Wikipedia 是一部多语言免费在线百科全书，由被称为维基人（Wikipedians）的志愿者社区通过开放协作方式，使用名为 MediaWiki 的基于 wiki 的编辑系统共同编写和维护。Wikipedia 是人类历史上最大、阅读量最多的参考资料。
本笔记本演示如何将 wikipedia.org 上的维基页面加载为下游使用的 Document 格式。

​
安装

首先，您需要安装 langchain_community 和 wikipedia 包。 
pip install -qU langchain_community wikipedia

​
参数

WikipediaLoader 具有以下参数：
  • query：用于在 Wikipedia 中搜索文档的自由文本
  • lang（可选）：默认为 “en”。用于在 Wikipedia 的特定语言版本中搜索
  • load_max_docs（可选）：默认为 100。用于限制下载文档数量。下载全部 100 个文档需要时间，实验时建议使用较小的数值。目前硬限制为 300。
  • load_all_available_meta（可选）：默认为 False。默认情况下只下载最重要的字段：title 和 summary。若设为 True，则下载所有可用字段。
  • doc_content_chars_max（可选）：默认为 4000。文档内容的最大字符数。

​
示例

from langchain_community.document_loaders import WikipediaLoader

docs = WikipediaLoader(query="HUNTER X HUNTER", load_max_docs=2).load()
len(docs)

2

docs[0].metadata  # 第一个文档的元数据

{'title': 'Hunter × Hunter',
 'summary': 'Hunter × Hunter (pronounced "hunter hunter") is a Japanese manga series written and illustrated by Yoshihiro Togashi. It has been serialized in Shueisha\'s shōnen manga magazine Weekly Shōnen Jump since March 1998, although the manga has frequently gone on extended hiatuses since 2006. Its chapters have been collected in 37 tankōbon volumes as of November 2022. The story focuses on a young boy named Gon Freecss who discovers that his father, who left him at a young age, is actually a world-renowned Hunter, a licensed professional who specializes in fantastical pursuits such as locating rare or unidentified animal species, treasure hunting, surveying unexplored enclaves, or hunting down lawless individuals. Gon departs on a journey to become a Hunter and eventually find his father. Along the way, Gon meets various other Hunters and encounters the paranormal.\nHunter × Hunter was adapted into a 62-episode anime television series by Nippon Animation and directed by Kazuhiro Furuhashi, which ran on Fuji Television from October 1999 to March 2001. Three separate original video animations (OVAs) totaling 30 episodes were subsequently produced by Nippon Animation and released in Japan from 2002 to 2004. A second anime television series by Madhouse aired on Nippon Television from October 2011 to September 2014, totaling 148 episodes, with two animated theatrical films released in 2013. There are also numerous audio albums, video games, musicals, and other media based on Hunter × Hunter.\nThe manga has been licensed for English release in North America by Viz Media since April 2005. Both television series have been also licensed by Viz Media, with the first series having aired on the Funimation Channel in 2009 and the second series broadcast on Adult Swim\'s Toonami programming block from April 2016 to June 2019.\nHunter × Hunter has been a huge critical and financial success and has become one of the best-selling manga series of all time, having over 84 million copies in circulation by July 2022.',
 'source': 'https://en.wikipedia.org/wiki/Hunter_%C3%97_Hunter'}

docs[0].page_content[:400]  # 页面内容的部分内容

'Hunter × Hunter (pronounced "hunter hunter") is a Japanese manga series written and illustrated by Yoshihiro Togashi. It has been serialized in Shueisha\'s shōnen manga magazine Weekly Shōnen Jump since March 1998, although the manga has frequently gone on extended hiatuses since 2006. Its chapters have been collected in 37 tankōbon volumes as of November 2022. The story focuses on a young boy name'
在 GitHub 上编辑此页面 或 提交问题。
将这些文档连接到 Claude、VSCode 等，通过 MCP 获取实时解答。