AgentPay Web Extract MCP server
Commit Oct 1, 2026Converts web pages to LLM-ready markdown and provides domain intelligence, PDF text extraction, and feed parsing via pay-per-call APIs.
Also known as noah-silver/agentpay, agentpay-extract
- Stars
- 0
- Tools
- —
- Downloads, 30 days
- —
- Latest version
- 1.1.0
- Last commit
- Oct 1, 2026
- License
- MIT
What is AgentPay Web Extract MCP?
AgentPay Web Extract converts web pages to LLM-ready markdown and provides domain intelligence, PDF text extraction, and feed parsing via pay-per-call APIs.
Summary generated from the project's README
About AgentPay Web Extract MCP server
AgentPay Web Extract provides specialized tools for AI agents to interact with web content and network data. It functions as a remote MCP server that converts URLs into clean markdown, extracts text from PDF documents, and parses RSS or Atom feeds into JSON. Developers can also access domain intelligence through tools that retrieve DNS records, WHOIS registration details, and IP ownership information.
This service operates on a pay-per-call model using USDC on the Base or Algorand networks via x402, or through prepaid API credits. Users can connect to the remote MCP servers using clients like Claude Desktop, Cursor, or Claude Code by providing an authorization header. The system is designed to be used without mandatory sign-ups, offering a free trial with a small amount of credit to test the extract_page, lookup_dns, and tools_pdf_text functions.
What you can do with it
- 1Convert web pages to markdownTransform any URL into clean, LLM-ready markdown including metadata and links.
- 2Extract text from PDF filesRetrieve per-page text from a PDF hosted at a specific URL.
- 3Perform domain intelligence researchGenerate a comprehensive report including registration, DNS, and hosting details for a domain.
- 4Parse website sitemapsGet a list of URLs from a site by following its sitemap and robots.txt.
Written from the project's README. Every use case is checked against a quote from it.
How to install AgentPay Web Extract MCP
Formats verified 10 Nov 2026Add to CursorAdd to GooseInstall AgentPay Web Extract MCP in Claude Code
$ claude mcp add --transport http agentpay-extract https://agentpay-extract.agentpay-apis.workers.dev/mcpInstall AgentPay Web Extract MCP in Cursor
~/.cursor/mcp.json
{
"mcpServers": {
"agentpay-extract": {
"url": "https://agentpay-extract.agentpay-apis.workers.dev/mcp"
}
}
}Install AgentPay Web Extract MCP in VS Code
.vscode/mcp.json
{
"servers": {
"agentpay-extract": {
"type": "http",
"url": "https://agentpay-extract.agentpay-apis.workers.dev/mcp"
}
}
}Install AgentPay Web Extract MCP in VS Code CLI
$ code --add-mcp '{"name":"agentpay-extract","type":"http","url":"https://agentpay-extract.agentpay-apis.workers.dev/mcp"}'Install AgentPay Web Extract MCP in Codex
$ codex mcp add agentpay-extract --url https://agentpay-extract.agentpay-apis.workers.dev/mcpInstall AgentPay Web Extract MCP in Codex config.toml
~/.codex/config.toml
[mcp_servers.agentpay-extract] url = "https://agentpay-extract.agentpay-apis.workers.dev/mcp"
Install AgentPay Web Extract MCP in Gemini CLI
$ gemini mcp add -s user --transport http agentpay-extract https://agentpay-extract.agentpay-apis.workers.dev/mcpInstall AgentPay Web Extract MCP in Gemini settings.json
~/.gemini/settings.json
{
"mcpServers": {
"agentpay-extract": {
"url": "https://agentpay-extract.agentpay-apis.workers.dev/mcp",
"type": "http"
}
}
}Automated checks
Ran Nov 15, 2026Full report →Not verified yet. A server needs a score of 80, no serious finding, and enough data for us to check. How checks work · What to fix for more points
- Source repository linked and reachablenoah-silver/agentpay is public and reachablegithub.com/noah-silver/agentpay ↗Pass
- Package names this repository as its sourceNot checked
- Build provenance (Sigstore attestation)Not checked
- Open source license (OSI)MITspdx.org/licenses/MIT.html ↗Pass
- Commit or release in the last yearLast commit or release 2026-10-01github.com/noah-silver/agentpay ↗Pass
- OpenSSF ScorecardNot checked
- Package name not close to a popular packageNot checked
- No critical advisory in the package or its dependenciesNot checked
- No hidden instructions to the model0 tool descriptions and the README read; no override phrases, credential paths or hidden charactersPass
- Destructive tools are labelledNot checked
- Remote endpoint answers the MCP handshakeinitialize answered with protocol 2025-06-18 in 135 msPass
README
View on GitHubAgentPay — pay-per-call APIs and MCP tools for AI agents
Web extraction, domain/network intelligence, and document tools that agents can use without signing up. Pay per request with x402 in USDC on Base or Algorand, or prepay credits for an API key. Every product is available as a REST API and as a remote MCP server.
| Product | What it does | Base URL | MCP server |
|---|---|---|---|
| Web Extract | Any URL → clean, LLM-ready markdown + title, metadata, Open Graph, canonical URL and links | https://agentpay-extract.agentpay-apis.workers.dev |
…/mcp |
| Domain & Network Lookup | DNS records, WHOIS/RDAP registration, IP ownership + reverse DNS, one-call domain report (email provider, SPF/DMARC, hosting) | https://agentpay-lookup.agentpay-apis.workers.dev |
…/mcp |
| Doc Tools | PDF → per-page text, RSS/Atom/JSON Feed → JSON, sitemap (via robots.txt) → URL list | https://agentpay-tools.agentpay-apis.workers.dev |
…/mcp |
| Bundle | All of the above on one host | https://agentpay.agentpay-apis.workers.dev |
…/mcp |
Machine-readable docs: /llms.txt ·
/openapi.json ·
/.well-known/x402
Endpoints and pricing
Same price on Base and Algorand. Invalid input is rejected before payment, and x402 payments are only settled if the call succeeds — failed calls cost nothing.
| Endpoint | Description | Price (USDC) |
|---|---|---|
GET /extract/v1/page?url= |
Web page → markdown, metadata, links (maxChars optional) |
$0.005 |
GET /lookup/v1/dns?name=&type= |
A, AAAA, CNAME, MX, NS, TXT, SOA, CAA, PTR, SRV | $0.005 |
GET /lookup/v1/whois?domain= |
Registrar, created/updated/expires, status, nameservers (RDAP) | $0.01 |
GET /lookup/v1/ip?ip= |
Network owner, range, country, reverse DNS | $0.01 |
GET /lookup/v1/domain-report?domain= |
Registration + DNS + email provider + SPF/DMARC + hosting | $0.02 |
GET /tools/v1/pdf-text?url= |
Per-page text from a PDF URL (≤20 MB) | $0.01 |
GET /tools/v1/feed?url=&limit= |
RSS / Atom / JSON Feed → normalized items | $0.005 |
GET /tools/v1/sitemap?url=&limit= |
Site URLs from sitemaps, following robots.txt and indexes | $0.005 |
GET /credits/buy?usd= |
Prepaid credits ($1–$500) → API key. +10% bonus at $5, +20% at $20 | = amount |
Paying
Free trial
GET https://agentpay.agentpay-apis.workers.dev/credits/trial returns an API key with $0.05 of free credit (one per network per day).
Use it as Authorization: Bearer <key> on any endpoint or MCP server.
Pay by hand with Pera Wallet
Open https://agentpay.agentpay-apis.workers.dev/pay, connect Pera, pick an endpoint (or buy credits), and approve the USDC payment in the app. Network fees are sponsored, so only USDC is needed.
x402 (no account)
Call any endpoint. You get 402 Payment Required with a base64 PAYMENT-REQUIRED header (x402 v2) offering:
- Base —
eip155:8453, USDC0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913, exact scheme (EIP-3009) - Algorand —
algorand:wGHE2Pwdvd7S12BL5FaOP20EGYesN73ktiC1qzkkit8=, USDC ASA31566704, exact scheme, network fees sponsored by the GoPlausible facilitator (extra.feePayer)
Any x402 v2 client handles this automatically:
import { wrapFetchWithPaymentFromConfig } from '@x402/fetch';
import { ExactEvmScheme } from '@x402/evm';
import { privateKeyToAccount } from 'viem/accounts';
const fetchWithPayment = wrapFetchWithPaymentFromConfig(fetch, {
schemes: [{ network: 'eip155:8453', client: new ExactEvmScheme(privateKeyToAccount(process.env.EVM_PRIVATE_KEY)) }],
});
const res = await fetchWithPayment('https://agentpay-lookup.agentpay-apis.workers.dev/lookup/v1/domain-report?domain=example.com');
console.log(await res.json());
Full example for both networks: examples/x402-client.mjs.
Prepaid credits (fastest for repeated use)
GET https://agentpay.agentpay-apis.workers.dev/credits/buy?usd=5 (paid once via x402) returns { "apiKey": "ak_…" }.
Send Authorization: Bearer ak_… on any endpoint or MCP server. Failed calls are refunded automatically.
Balance: GET /credits/balance. Algorand holders can also pay by transfer: examples/buy-credits.mjs.
Using the MCP servers
Remote MCP over Streamable HTTP. Listing tools is free; tool calls are paid via x402
(params._meta["x402/payment"], per the x402 MCP transport) or with a credits key header.
Claude Code
claude mcp add --transport http agentpay-lookup https://agentpay-lookup.agentpay-apis.workers.dev/mcp --header "Authorization: Bearer ak_..."
Cursor / Claude Desktop / any client with remote MCP support
{
"mcpServers": {
"agentpay-extract": { "url": "https://agentpay-extract.agentpay-apis.workers.dev/mcp", "headers": { "Authorization": "Bearer ak_..." } },
"agentpay-lookup": { "url": "https://agentpay-lookup.agentpay-apis.workers.dev/mcp", "headers": { "Authorization": "Bearer ak_..." } },
"agentpay-tools": { "url": "https://agentpay-tools.agentpay-apis.workers.dev/mcp", "headers": { "Authorization": "Bearer ak_..." } }
}
}
| MCP server | Tools |
|---|---|
| agentpay-extract | extract_page |
| agentpay-lookup | lookup_dns, lookup_whois, lookup_ip, lookup_domain_report |
| agentpay-tools | tools_pdf_text, tools_feed, tools_sitemap |
| agentpay (bundle) | all 8 |
Example responses
GET /lookup/v1/whois?domain=anthropic.com
{ "domain": "anthropic.com", "registered": true, "registrar": "MarkMonitor Inc.", "created": "2001-10-02T18:10:32Z",
"expires": "2033-10-02T18:10:32Z", "status": ["client delete prohibited", "client transfer prohibited"],
"nameservers": ["isla.ns.cloudflare.com", "randy.ns.cloudflare.com"], "source": "RDAP" }
GET /lookup/v1/ip?ip=1.1.1.1
{ "ip": "1.1.1.1", "version": 4, "reverseDns": ["one.one.one.one."],
"network": { "name": "APNIC-LABS", "range": "1.1.1.0 - 1.1.1.255", "country": "AU", "organization": "APNIC Research and Development" } }
Data sources
DNS over HTTPS (Cloudflare 1.1.1.1), IANA RDAP bootstrap → authoritative registry RDAP servers, and the regional internet registries. Web, PDF, feed and sitemap tools fetch the URL you provide at request time.
Support
Open an issue in this repository.
AgentPay Web Extract MCP questions
How do I add AgentPay Web Extract MCP to Claude Code?
Run claude mcp add --transport http agentpay-extract https://agentpay-extract.agentpay-apis.workers.dev/mcp in your terminal. Add --scope user to make it available in every project.
How do I add AgentPay Web Extract MCP to Cursor?
Open ~/.cursor/mcp.json and add the server under mcpServers, using the Cursor config shown in the install section above.
How much does it cost to extract a web page?
The cost for the web page to markdown extraction endpoint is $0.005 USDC.
Do I need to sign up to use these tools?
No, agents can use the web extraction, domain intelligence, and document tools without signing up by using pay-per-call via x402.
What happens if a tool call fails?
Failed calls cost nothing because x402 payments are only settled if the call succeeds.
Is there a free trial available?
Yes, you can get an API key with $0.05 of free credit by calling the trial endpoint once per network per day.