ブラウザと同等のリクエストを使用して、AIエージェントによるウェブ検索や、通常は自動スクレイピングをブロックするサイトからのコンテンツ取得を可能にします。
別名 aliasmode/anyfetch, @aliasmode/anyfetch
- スター
- 2
- ツール
- 28
- ダウンロード数(30日間)
- 1,464
- 最新バージョン
- 0.8.3
- 最終コミット
- 2026年10月21日
- ライセンス
- Apache-2.0
Anyfetch MCPとは
AnyfetchはMCPサーバーです。 ブラウザと同等のリクエストを使用して、AIエージェントによるウェブ検索や、通常は自動スクレイピングをブロックするサイトからのコンテンツ取得を可能にします。. 28個のツールを提供しており、url, query, max_charsなどがあります。
プロジェクトのREADMEから生成された概要
Anyfetch MCP server について
Anyfetchは、AIエージェントが制限されたウェブコンテンツにアクセスし、深いリサーチを行うことを可能にします。SafariのTLSやHTTP/2のフィンガープリントを模倣したブラウザグレードのリクエストを送信することで、一般的な403エラーやボット検知を回避する手段を提供します。これにより、The New York Times、Reuters、Bloomberg、Redditなど、通常は自動スクレイパーをブロックするサイトの読み取りが可能になります。
開発者は、Claude Code、Cursor、Clineなどのクライアントとstdio MCP serverとして利用するか、通常のCLI経由で利用できます。APIキーは不要で、16 MBの軽量なRustバイナリとして動作します。サーバーにはweb_search、web_fetch、web_fetch_manyのツールが含まれており、Brave、DuckDuckGo、Yahooを対象としたクエリや、GitHub、Stack Overflow、arXivでの専門的な検索が可能です。また、長いページやPDFから特定の回答を抽出することもでき、コンテキストウィンドウのスペースを節約するために、ドキュメント全体ではなくクリーンなMarkdownを返します。
できること
- 1スクレイピングのブロックを回避AIエージェントが、通常は自動リクエストを拒否する主要なパブリッシャーのニュース記事を読み取ることができます。
- 2ターゲットを絞ったリサーチクエリ開発者が特定のURLに関する質問を行い、そのページの関連セクションのみを受け取ることができます。
- 3専門的な技術検索専用のプロバイダーを使用して、特定の技術ドキュメントや研究論文を検索できます。
- 4効率的な一括取得エージェントが複数のウェブページを同時に取得・処理し、データ収集を高速化できます。
プロジェクトの README から作成されています。すべてのユースケースは、その引用と照らし合わせて確認されています。
Anyfetch MCPのインストール方法
フォーマット検証日 2026年11月10日Cursor に追加Claude CodeにAnyfetch MCPをインストール
$ claude mcp add anyfetch -- npx -y @aliasmode/anyfetchCursorにAnyfetch MCPをインストール
~/.cursor/mcp.json
{
"mcpServers": {
"anyfetch": {
"command": "npx",
"args": [
"-y",
"@aliasmode/anyfetch"
]
}
}
}VS CodeにAnyfetch MCPをインストール
.vscode/mcp.json
{
"servers": {
"anyfetch": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"@aliasmode/anyfetch"
]
}
}
}VS Code CLIにAnyfetch MCPをインストール
$ code --add-mcp '{"name":"anyfetch","type":"stdio","command":"npx","args":["-y","@aliasmode/anyfetch"]}'Claude DesktopにAnyfetch MCPをインストール
claude_desktop_config.json
{
"mcpServers": {
"anyfetch": {
"command": "npx",
"args": [
"-y",
"@aliasmode/anyfetch"
]
}
}
}CodexにAnyfetch MCPをインストール
~/.codex/config.toml
[mcp_servers.anyfetch] command = "npx" args = ["-y", "@aliasmode/anyfetch"]
Gemini CLIにAnyfetch MCPをインストール
~/.gemini/settings.json
{
"mcpServers": {
"anyfetch": {
"command": "npx",
"args": [
"-y",
"@aliasmode/anyfetch"
]
}
}
}Anyfetch MCPツール 28
READMEから検出urlquerymax_charsoffsetfreshurlsprovidersitetimepagereadsearxng_url
| url | — | |
| query | — | |
| max_chars | — | |
| offset | — | |
| fresh | — | |
| urls | — | |
| provider | — | |
| site | — | |
| time | — | |
| page | — | |
| read | — | |
| searxng_url | — |
28個のツールをすべて表示ツールを折りたたむ
autobraveyahooduckduckgosearxnggithubstackoverflowhackernewsarxivpaperschallenge_requiredhttp_errorrate_limitedtimeoutunsupported_contentextraction_failed
| auto | — | |
| brave | — | |
| yahoo | — | |
| duckduckgo | — | |
| searxng | — | |
| github | — | |
| stackoverflow | — | |
| hackernews | — | |
| arxiv | — | |
| papers | — | |
| challenge_required | — | |
| http_error | — | |
| rate_limited | — | |
| timeout | — | |
| unsupported_content | — | |
| extraction_failed | — |
自動チェック
実行日 2026年11月12日詳細レポート →自動チェックに合格しました。これはセキュリティ監査ではありません。コードを読み、サーバーに必要最小限のアクセス権を与えてください。 チェックの仕組み
- ソースリポジトリがリンクされており、アクセス可能合格
- オープンソースライセンス (OSI)合格
- 過去1年以内にコミットまたはリリースあり合格
- パッケージ名が有名なパッケージに酷似していない合格
- リモートエンドポイントがHTTPSを使用未チェック
- 破壊的なツールがラベル付けされている合格
- モデルへの隠れた指示がない合格
- パッケージと依存関係に重大なアドバイザリがない合格
README
GitHubで見るAnyfetch
Web search and web fetch for AI agents. One small binary, no API keys, and it reads the sites that refuse your agent.
Free and open source, from the makers of AliasMode.
Agent harnesses fetch pages with a bot identity, and a large part of the web answers 403. Anyfetch sends the request a real browser sends, so your agent gets the page.
| 97 popular sites that block AI agents | Pages read |
|---|---|
| Anyfetch | 82 |
| Anyfetch with a NobleProxy residential IP | 87 |
| curl | 46 |
| Reference MCP fetch server | 39 |
Claude Code built-in WebFetch |
36 |
Anyfetch read 28 sites that no other tool in the table could read. Among them: The New York Times, Reuters, Bloomberg, The Washington Post, The Economist, Medium, Reddit, Stack Overflow, IMDb and YouTube.
| 33 research questions, each asked twice | Answered correctly both times |
|---|---|
| Agent with Anyfetch | 32 |
Same agent with Claude Code built-in WebSearch and WebFetch |
27 |
Thirteen of the questions are about a page on a site that blocks AI agents. The built-in fetch could not read any of those 13 pages. Its search found the answer in another source for 7 of them. Anyfetch answered 12 in both runs. The questions were written from pages that Anyfetch can read, so this group shows what the built-in tools miss.
| One page, started fresh | Time | Peak memory |
|---|---|---|
| Anyfetch | 0.19 s | 17 MB |
| Headless Chromium | 1.15 s | 544 MB |
Sites: measured on 2026-10-12 with version 0.8.0. Questions: measured on 2026-10-12 with version 0.7.1. Time and memory: measured on 2026-10-11. All from a cloud server, with no proxy except in the proxy row. See how we measured and how to run it again.
What your agent gets
- Search with no key. Brave, Yahoo and DuckDuckGo results, with domain and date filters, quoted phrases and paging. Specialist sources for GitHub, Stack Overflow, Hacker News, arXiv and research papers. Or your own SearXNG.
- Search and read in one call. Ask for the top results together with the result list, and get the parts of each page that match your query.
- Answers, not whole pages. Give a question with the URL, and get only the parts of the page that match it. The Python 3.15 release notes are 218,000 characters; the answer to one question about them came back in 2,200.
- Clean Markdown. Links, tables and code blocks stay intact. Long pages come in parts.
- PDFs. Papers and reports come back as text, page by page.
- Sites that need JavaScript. Anyfetch reads the data inside the page, and uses the site's public API or feed for Stack Overflow, Reddit, IMDb, X posts, PyPI and crates.io. A Reddit thread comes with every comment and its score. No browser runs. For pages that hold nothing without their scripts, it can use Lightpanda, an optional small engine.
- News and answers. Full articles on Reuters and Bloomberg, the latest articles of The Economist, and the answers on Quora, from the data that these sites send.
- Home pages and listings. A page with no single article comes back as its headlines and links, in page order.
- Browser-grade requests. Safari's TLS, HTTP/2 and header fingerprint. A refused fetch is retried automatically, as the same browser or as a second one. Bot checks that are one fixed step, as on Reddit and Behance, are passed.
- Cloudflare checks. When a site insists on a JavaScript check, your own Firefox passes it once. After that, Anyfetch reads the site with plain requests.
- Fast on repeat. Several pages in one call, fetched at the same time. A page fetched in the last 15 minutes comes from a local copy.
- Lightweight. A 16 MB Rust binary. No bundled browser, no JavaScript engine, no Python, no Node.
- Works everywhere. A stdio MCP server for agent harnesses, and a plain CLI for everything else.
Install
macOS and Linux:
curl -fsSL https://aliasmode.github.io/anyfetch/install.sh | sh
Windows, in PowerShell:
irm https://aliasmode.github.io/anyfetch/install.ps1 | iex
The installer puts anyfetch in ~/.local/bin. Then it connects Anyfetch to each agent harness that it finds on the machine: Claude Code, Codex, Gemini CLI, Hermes Agent, Pi, Cline, Amp, OpenClaw and Cursor. Start a new agent session, and the agent has web_search, web_fetch and web_fetch_many.
Did you install a harness later? Run anyfetch setup. It uses each harness's own command, tells you what it connected, and is safe to run again.
Do you have Node.js? Then no install is needed. Give your MCP client this server, and npx gets the program for your platform:
{
"mcpServers": {
"anyfetch": { "command": "npx", "args": ["-y", "@aliasmode/anyfetch", "mcp"] }
}
}
Only Claude Code, on macOS or Linux? You can install Anyfetch as a plugin instead. The plugin gets the program at its first start:
claude plugin marketplace add aliasmode/anyfetch && claude plugin install anyfetch@anyfetch
Inside Claude Code 2.1.275 or later, this is one step: /plugin install anyfetch --marketplace aliasmode/anyfetch. Use the plugin or the installer, not both, or the agent sees every tool twice.
Connect your agent by hand
anyfetch setup does this for you. To do it by hand, each harness needs one command.
Claude Code
claude mcp add --scope user anyfetch -- anyfetch mcp
Codex
codex mcp add anyfetch -- anyfetch mcp
or in ~/.codex/config.toml:
[mcp_servers.anyfetch]
command = "anyfetch"
args = ["mcp"]
Hermes Agent
hermes mcp add anyfetch --command anyfetch --args mcp
Hermes connects, lists the tools and asks to enable them. Answer Y.
Pi
pi mcp add anyfetch -- anyfetch mcp
Pi hides MCP tools behind its code mode by default. To show the tools to the model directly, set the exposure in ~/.pi/agent/mcp.json:
{
"mcpServers": {
"anyfetch": { "command": "anyfetch", "args": ["mcp"], "exposure": "direct" }
}
}
Gemini CLI
gemini mcp add -s user anyfetch anyfetch mcp
OpenCode — in ~/.config/opencode/opencode.json:
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"anyfetch": { "type": "local", "command": ["anyfetch", "mcp"], "enabled": true }
}
}
Cursor — in ~/.cursor/mcp.json:
{
"mcpServers": {
"anyfetch": { "command": "anyfetch", "args": ["mcp"] }
}
}
More harnesses
| Harness | Command |
|---|---|
| Cline | cline mcp add anyfetch --yes -- anyfetch mcp |
| Amp | amp mcp add anyfetch -- anyfetch mcp |
| OpenClaw | openclaw mcp add anyfetch --command anyfetch --arg mcp |
| Goose | goose session --with-extension "anyfetch mcp" |
| VS Code (Copilot) | code --add-mcp "{\"name\":\"anyfetch\",\"command\":\"anyfetch\",\"args\":[\"mcp\"]}" |
Any other MCP client: add a stdio server with the command anyfetch and the argument mcp.
Anyfetch is in the official MCP Registry as io.github.aliasmode/anyfetch, and on npm as @aliasmode/anyfetch.
No MCP? Give the agent the CLI. Add this to AGENTS.md or the harness's instruction file:
## Web access
- Search the web: `anyfetch search "<query>"`
- Read pages: `anyfetch fetch <url> [<url>...] --format markdown`
Make it the default. Anyfetch tells the agent to use its tools in place of the built-in web tools. In our test with Claude Code, the agent then chose Anyfetch for 8 of 8 web tasks. Before, it chose Anyfetch for 2 of 8. To take the choice away, turn the built-ins off:
- Claude Code, in
~/.claude/settings.json:"permissions": { "deny": ["WebFetch", "WebSearch"] } - Codex, in
~/.codex/config.toml:web_search = "disabled"
Use it from the command line
anyfetch search "rust async runtime comparison"
anyfetch search "tokio select" --site docs.rs --time year
anyfetch search "postgres vacuum freeze" --read 3
anyfetch search "retrieval augmented generation" --provider papers
anyfetch fetch https://stackoverflow.com/questions/231767 --format markdown
anyfetch fetch https://arxiv.org/pdf/1706.03762 --max-chars 8000 --offset 8000
anyfetch fetch https://docs.python.org/3.15/whatsnew/3.15.html --query "sampling profiler rate"
anyfetch fetch https://www.rust-lang.org/ https://go.dev/ https://ziglang.org/
Output is JSON by default, so scripts and agents can parse it. --format markdown prints only the page content.
Tools
web_fetch
| Input | Meaning |
|---|---|
url |
The page to read. |
query |
Optional. A question or keywords. The result has only the parts of the page that match. |
max_chars |
Optional. The most content characters to return. The default is 50,000, or 5,000 with a query. |
offset |
Optional. The first content character to return. Not used with a query. |
fresh |
Optional. Fetch again even if a copy from the last 15 minutes exists. |
The result has title, description, content (Markdown), total_chars, url (after redirects), status and retrieved_at. To read a long page in parts, call again with a higher offset until it reaches total_chars. The parts come from the local copy, so the site gets one request.
With a query, the page is split at its paragraphs, tables and code blocks. The parts that best match the words of the query come back in page order, under their headings, with [...] where parts are left out. The result then has focused: true. A page with no matching part comes back from its start. A second question about the same page uses the local copy.
HTML becomes Markdown. A PDF becomes text with [Page N] marks. JSON, plain text and XML feeds come back as they are.
web_fetch_many
| Input | Meaning |
|---|---|
urls |
The pages to read. They are fetched at the same time. |
query |
Optional. As for web_fetch. Each page gives up to 5,000 characters. |
max_chars |
Optional. The most content characters per page. By default the pages share 50,000. |
fresh |
Optional. As for web_fetch. |
The result has pages: one entry per URL, in order. Each entry is the page, or its error.
web_search
| Input | Meaning |
|---|---|
query |
The search query. Quoted phrases work. |
provider |
Optional. See the list below. The default is auto. |
site |
Optional. Keep results from one domain, for example docs.rs. |
time |
Optional. day, week, month or year. |
page |
Optional. The result page, from 1. |
read |
Optional. Also return, from this many top results, the parts of each page that match the query. |
searxng_url |
The base URL of your SearXNG instance, for the searxng provider. It must have JSON output on. |
Each result has title, url and snippet, and content when you set read.
| Provider | Source |
|---|---|
auto |
Brave, Yahoo and DuckDuckGo at the same time. Their lists are merged, and pages that several engines rank high come first. engines names the engines that answered. |
brave |
Brave Search. About 20 results per page. |
yahoo |
Yahoo Search. 7 results per page. No year filter. |
duckduckgo |
DuckDuckGo. First page only. |
searxng |
Your own SearXNG instance. |
github |
GitHub repositories, with stars and language. |
stackoverflow |
Stack Overflow questions, with score and answer count. |
hackernews |
Hacker News stories, with points and the discussion link. |
arxiv |
arXiv papers, with abstracts. |
papers |
Research papers from OpenAlex, with citation counts and open-access links. |
site, time and quoted phrases apply to the web engines. The specialist sources are free public APIs with their own request limits.
Errors
A failed call returns an error object with a code the agent can act on:
| Code | Meaning |
|---|---|
challenge_required |
The site answered with a bot challenge that needs a browser. |
http_error |
The site refused the request. status has the HTTP code. |
rate_limited |
The site asked to slow down. retry_after has the wait, when given. |
timeout |
The site did not answer within 30 seconds. |
unsupported_content |
The URL is not text or a PDF (an image, for example). |
extraction_failed |
The page has no readable content. A scanned PDF has no text. |
Cloudflare checks
Some sites answer every first request with a JavaScript check. Anyfetch handles it in two steps:
- Your own Firefox passes the check once. It runs hidden, with a throwaway profile, for a few seconds.
- Anyfetch saves the clearance for that site and goes back to plain requests. On Medium, one pass is good for a year.
In our test, the first page of such a site took about 5 seconds and the next one under 2 seconds.
This needs Firefox, or a Firefox-based browser, on the machine. Without one, nothing changes: the fetch returns challenge_required.
| Setting | Effect |
|---|---|
ANYFETCH_BROWSER=off |
Never start a browser. |
ANYFETCH_BROWSER=/path/to/browser |
Use this Firefox-based browser. |
For an MCP server, set the variable in the server entry. In Claude Code:
claude mcp add --scope user anyfetch -e ANYFETCH_BROWSER=off -- anyfetch mcp
Notes:
- Tested on Linux. On Windows, and for a snap-packaged Firefox (the Ubuntu default), the browser is used only when
ANYFETCH_BROWSERnames it. - A clearance belongs to the address that earned it, so the browser is not used together with a proxy.
- Saved clearances are in
~/.config/anyfetch/clearance/. Delete a file to forget a site.
Pages that need their scripts
Most pages give Anyfetch their text without JavaScript: it is in the HTML, in the page's data, or behind a public API. A few hold nothing until their scripts run. MSN, Spotify and Airbnb are examples. For those, Anyfetch can use Lightpanda, a small headless engine without a full browser.
Lightpanda is optional and separate. Install it from its README, put lightpanda on your PATH, and Anyfetch uses it for the pages that need it. In our test, MSN went from no content to 154,000 characters in 12 seconds, and Spotify from no content to 23,000 characters in 3 seconds. Pages that already work are not rendered, so they stay fast.
| Setting | Effect |
|---|---|
ANYFETCH_RENDERER=off |
Never start the renderer. |
ANYFETCH_RENDERER=/path/to/lightpanda |
Use this program. |
Notes:
- Lightpanda makes its own requests. It is not used together with a proxy, and a site with a bot check can refuse it.
- A rendered application page, such as a feed or a listing, comes back as the whole page in Markdown.
Use a proxy
Some sites refuse cloud server addresses whatever the request looks like. If your agent runs on a server, send Anyfetch through a residential proxy. Put one line in ~/.config/anyfetch/proxy:
host:port:username:password
Anyfetch then sends every search and fetch through that HTTP proxy. The file holds the password in plain text, so keep it private: chmod 600 ~/.config/anyfetch/proxy. Delete the file to go direct again.
Some sites accept your own address and refuse the proxy's address. To reach both kinds, add a second line with the word direct. Anyfetch then tries the proxy first, and asks the site directly when the proxy route is refused.
Need a proxy? Use NobleProxy, our own service. In our test, one NobleProxy address took Anyfetch from 82 to 87 of the 97 sites, with the same result in every run. It opened The Wall Street Journal, Tripadvisor, Yelp, Etsy and Bandcamp, which refuse a server address. You get a static residential IP that only you use, with unlimited bandwidth and HTTP support.
What it does not do
Anyfetch itself does not run JavaScript, solve CAPTCHAs or log in. A page that shows its content only after its scripts run, with no data inside the HTML and no public API, returns its title and description unless Lightpanda is installed. It reads what a site sends to a first-time visitor. A page that needs a CAPTCHA, an account or a subscription to load stays closed, and Anyfetch says so with an error code.
Does your agent need a real browser, with logins and saved sessions? Use AliasMode. It is our free, open-source antidetect browser, and it has its own MCP server for agents.
Benchmark
The numbers at the top come from two scripts and one question set in bench/.
-
Pages read.
bench/bench.pyreads each of the 97 sites inbench/sites.txtonce with each tool. A page counts as read when the tool returns at least 500 characters of text and the text is not a bot check. The same rule is applied to every tool. Anyfetch ran three times and read 82, 81 and 82 pages; the table shows the middle run. Through a NobleProxy static residential IP, a fixed address of a US cable provider, with thedirectline in the proxy file, it read 87 pages in each of three runs. The proxy added The Wall Street Journal, Tripadvisor, Yelp, Etsy and Bandcamp. The other tools were not tested through the proxy. Claude Code'sWebFetchcannot be scripted, so an agent called it once per site and recorded if real content came back. -
Time and memory.
bench/speed.pyreads 10 pages with each program, started fresh for every page, and reports the median. -
Research questions.
bench/tasks.jsonhas 33 questions. Each has one exact answer and the sentence on the source page that proves it. The pages are from July to October 2026, so a model cannot answer from memory. A Claude Sonnet agent answered the questions with Anyfetch only, and again with the built-inWebSearchandWebFetchof Claude Code only. The instructions were the same: at most 8 web calls for each question, and the answerUNKNOWNwhen the tools do not give it. Anyfetch ran with no proxy, no Firefox and no Lightpanda. Each tool ran twice, and a question counts when both runs are correct.
| Question group | Anyfetch | Built-in tools |
|---|---|---|
| A page on a site that blocks AI agents | 12 of 13 | 7 of 13 |
| A page on an open site | 10 of 10 | 10 of 10 |
| No URL: search first, then read | 10 of 10 | 10 of 10 |
In single runs, Anyfetch answered 32 and 33 questions, and the built-in tools 28 and 27. The one Anyfetch miss was a Reddit thread: Reddit limited the rate of the test machine that day, and in one run Anyfetch read a link from a comment in place of the link of the post.
Three things to know about this test. The question writer used Anyfetch to check each answer, so the first group has only pages that Anyfetch can read. The Financial Times was on the writer's list and has no question: its articles need a subscription. Thirty of the questions are one day older than the test; 28 of their answers were checked on the source page again that day. Every answer is in bench/results/tasks.tsv.
We also read the same 97 sites with eight other tools, each with its default settings and no API key:
| Tool | Pages read |
|---|---|
| Anyfetch | 82 |
| Exa MCP (hosted, answers from stored copies) | 78 |
| Scrapling, stealth browser | 71 |
| Scrapling, plain HTTP | 69 |
Hermes Agent web_extract (hosted readers) |
68 |
| Crawl4AI | 66 |
| Jina Reader | 61 |
| Playwright MCP | 52 |
| DuckDuckGo MCP server | 49 |
How each one ran, and what to know before you compare, is in bench/other-tools/NOTES.md. The full ranking with every site is on aliasmode.com.
The per-site results are in bench/results/. Sites change their rules often, and results differ between networks, so run it yourself:
python3 bench/bench.py anyfetch curl
pip install mcp-server-fetch && python3 bench/bench.py reference
python3 bench/speed.py /path/to/chromium
Build from source
You need Rust 1.98, cmake and clang (the TLS library is BoringSSL). On Windows you also need NASM.
cargo install --git https://github.com/aliasmode/anyfetch
License
Apache-2.0
Anyfetch MCPのよくある質問
Anyfetch MCPをClaude Codeに追加するには
ターミナルでclaude mcp add anyfetch -- npx -y @aliasmode/anyfetchを実行します。すべてのプロジェクトで利用するには--scope userを追加します。
Anyfetch MCPをCursorに追加するには
~/.cursor/mcp.jsonを開き、上記のインストールセクションに示すCursor設定を使ってmcpServersの下にサーバーを追加します。
Anyfetch MCPが提供するツールは
28個のツールを提供しており、url, query, max_chars, offset, freshなどがあります。
AnyfetchはAIエージェントをブロックするウェブサイトを読み取れますか?
はい。SafariのTLS、HTTP/2、およびヘッダーフィンガープリントを含むブラウザグレードのリクエストを使用することで、多くのボット検知や403エラーを回避します。
JavaScriptを多用するウェブサイトにはどのように対応しますか?
RedditやStack Overflowなどの特定のプラットフォームでは、サイトの公開APIまたはフィードを使用します。また、スクリプトが必要なページに対しては、オプションでLightpandaを使用できます。
取得したコンテンツはどのような形式で返されますか?
サーバーはクリーンなMarkdownを返します。リンク、テーブル、コードブロックはそのまま保持されます。