Extract clean Markdown content, metadata, tech stacks, and SEO audits from any URL using a pay-per-call intelligence model.
Also known as ArceeDev/web-intel-mcp, web-intel-mcp
- Stars
- 0
- Tools
- —
- Downloads, 30 days
- 271
- Latest version
- 0.2.1
- Last commit
- Nov 10, 2026
- License
- —
What is Web Intel MCP?
Web Intel extracts clean Markdown content, metadata, tech stacks, and SEO audits from any URL using a pay-per-call intelligence model.
Summary generated from the project's README
About Web Intel MCP server
Web Intel provides agent-ready web intelligence through a pay-per-call model. It allows developers to extract structured data from any URL, including clean Markdown content, metadata, and technical stacks. The server uses KeyFlint for license verification and credit management, ensuring that users only pay for successful requests. If a fetch fails, the system automatically issues a refund.
Users can integrate this server into Claude Desktop, Cursor, Windsurf, or Claude Code using a KeyFlint license key. The server offers specific tools like read_url for content extraction, tech_stack for identifying frameworks and CMS, and seo_audit for performance grading. It also includes a compare_seo tool to rank multiple pages against competitors. For those running a service, a hosted Docker mode is available to manage multiple buyers through a single process.
Clients can monitor their usage through the credits_balance tool. The system includes safety measures such as a 3 MB response cap, a 15 second timeout, and restrictions on private or loopback address requests to ensure secure browsing.
What you can do with it
- 1Extract clean website contentRequest the main text of a webpage without navigation menus or cookie banners.
- 2Identify website technologiesDetermine which frameworks, CMS, or hosting providers a specific website uses.
- 3Perform SEO performance auditsGet a weighted score and a list of the top five necessary fixes for a webpage.
Written from the project's README. Every use case is checked against a quote from it.
How to install Web Intel MCP
Formats verified 10 Nov 2026Add to CursorAdd to GooseInstall Web Intel MCP in Claude Code
$ claude mcp add --env 'KEYFLINT_LICENSE=<YOUR_KEYFLINT_LICENSE>' web-intel-mcp -- uvx web-intel-mcpInstall Web Intel MCP in Cursor
~/.cursor/mcp.json
{
"mcpServers": {
"web-intel-mcp": {
"command": "uvx",
"args": [
"web-intel-mcp"
],
"env": {
"KEYFLINT_LICENSE": "<YOUR_KEYFLINT_LICENSE>"
}
}
}
}Install Web Intel MCP in VS Code
.vscode/mcp.json
{
"servers": {
"web-intel-mcp": {
"type": "stdio",
"command": "uvx",
"args": [
"web-intel-mcp"
],
"env": {
"KEYFLINT_LICENSE": "<YOUR_KEYFLINT_LICENSE>"
}
}
}
}Install Web Intel MCP in VS Code CLI
$ code --add-mcp '{"name":"web-intel-mcp","type":"stdio","command":"uvx","args":["web-intel-mcp"],"env":{"KEYFLINT_LICENSE":"<YOUR_KEYFLINT_LICENSE>"}}'Install Web Intel MCP in Claude Desktop
claude_desktop_config.json
{
"mcpServers": {
"web-intel-mcp": {
"command": "uvx",
"args": [
"web-intel-mcp"
],
"env": {
"KEYFLINT_LICENSE": "<YOUR_KEYFLINT_LICENSE>"
}
}
}
}Install Web Intel MCP in Codex
$ codex mcp add web-intel-mcp --env 'KEYFLINT_LICENSE=<YOUR_KEYFLINT_LICENSE>' -- uvx web-intel-mcpInstall Web Intel MCP in Codex config.toml
~/.codex/config.toml
[mcp_servers.web-intel-mcp] command = "uvx" args = ["web-intel-mcp"] [mcp_servers.web-intel-mcp.env] KEYFLINT_LICENSE = "<YOUR_KEYFLINT_LICENSE>"
Install Web Intel MCP in Gemini CLI
$ gemini mcp add -s user -e 'KEYFLINT_LICENSE=<YOUR_KEYFLINT_LICENSE>' web-intel-mcp uvx -- web-intel-mcpInstall Web Intel MCP in Gemini settings.json
~/.gemini/settings.json
{
"mcpServers": {
"web-intel-mcp": {
"command": "uvx",
"args": [
"web-intel-mcp"
],
"env": {
"KEYFLINT_LICENSE": "<YOUR_KEYFLINT_LICENSE>"
}
}
}
}Configuration
KEYFLINT_LICENSERequiredSecretYour KeyFlint license (LIC-...). Get one, free trial included, at https://mcp.keyflint.dev
Automated checks
Ran Nov 14, 2026Full report →Passed our automated checks. That is not a security audit: read the code and give the server the narrowest access it needs. How checks work · What to fix for more points
- Source repository linked and reachablearceedev/web-intel-mcp is public and reachablegithub.com/arceedev/web-intel-mcp ↗Pass
- Package names this repository as its sourceweb-intel-mcp names arceedev/web-intel-mcp as sourcepypi.org/project/web-intel-mcp/ ↗Pass
- Build provenance (Sigstore attestation)Sigstore attestation for web-intel-mcppypi.org/project/web-intel-mcp/ ↗Pass
- Open source license (OSI)No licenseFinding
- Commit or release in the last yearLast commit or release 2026-11-10github.com/arceedev/web-intel-mcp ↗Pass
- OpenSSF ScorecardNot checked
- Package name not close to a popular packageNo popular package one edit away from web-intel-mcpPass
- No critical advisory in the package or its dependencies37 resolved dependencies checked; no critical advisoryosv.dev ↗Pass
- No hidden instructions to the model0 tool descriptions and the README read; no override phrases, credential paths or hidden charactersPass
- Destructive tools are labelledNot checked
- Remote endpoint answers the MCP handshakeHTTPS endpoint answered 401 (sign-in required)Pass
README
View on GitHubWeb Intel MCP
Agent-ready web intelligence as a pay-per-call MCP server. Licensing and credits are handled by KeyFlint (offline Ed25519 license check + credit ledger), used here only as the billing backend. Failed fetches are refunded automatically; invalid input is rejected before any debit.
| Tool | Credits | Returns |
|---|---|---|
read_url |
1 | Main content as clean Markdown (nav, footer, cookie banners removed) |
page_metadata |
1 | Title, description, canonical, lang, robots, Open Graph, JSON-LD types, H1-H3, image alt stats |
extract_links |
1 | Deduplicated internal / external links with anchor text |
tech_stack |
2 | Frameworks, CMS, analytics, payments, CDN/hosting, security headers |
seo_audit |
3 | 0-100 score, A-F grade, 16 weighted checks, top 5 fixes |
compare_seo |
3 x URLs | Ranks 2-5 pages (you vs competitors); only fetched URLs are billed |
pricing, credits_balance |
free | Price list, remaining credits |
Prices are overridable: WEB_INTEL_PRICES="seo_audit=5,read_url=2".
Install
All you need is your KeyFlint license (LIC-...). The gateway URL, its public key and the checkout link have defaults.
Claude Desktop, one click: download web-intel-mcp-X.Y.Z.mcpb from the latest release, double-click it and paste your license. No terminal, no JSON.
Claude Code:
claude mcp add web-intel -e KEYFLINT_LICENSE=LIC-... -- uvx web-intel-mcp
Cursor, Windsurf, Claude Desktop (JSON):
{
"mcpServers": {
"web-intel": {
"command": "uvx",
"args": ["web-intel-mcp"],
"env": { "KEYFLINT_LICENSE": "LIC-..." }
}
}
}
Optional: KEYFLINT_URL, KEYFLINT_PUBLIC_KEYS (fetched from the gateway and cached in ~/.keyflint/keyring.json when unset), KEYFLINT_CHECKOUT_URL.
Visual cards (MCP Apps)
In Claude, ChatGPT, VS Code and Goose every paid tool and credits_balance renders as an interactive card in the
chat: credit balance with a refill bar and a buy button, or a result summary (key figures, issues, table preview and
credits charged). It is the ui://web-intel/card.html resource, self-contained with no network access. Other clients
keep getting the same JSON as before.
Hosted mode (sellers)
Paid logic stays on your server. One process bills many buyers; each request carries the buyer's license.
docker build -t web-intel .
docker run -p 8080:8080 \
web-intel
Buyers connect to https://<host>/mcp (Streamable HTTP, stateless) with
Authorization: Bearer LIC-... (or X-License-Key). Missing or forged licenses get -32060.
Billing flow per call
- URL validated (http/https only). Bad input: error, nothing charged.
- Offline Ed25519 license check (
keyflint-verify), cached 60 s. POST /api/v1/quota/deductwith a fresh idempotency key. Out of credits:-32062with the checkout link.- Fetch + analysis. If anything fails:
POST /api/v1/quota/refund(same key), the client getsisError.
Safety
Requests to private, loopback and link-local addresses are refused (checked on every redirect hop),
responses are capped at 3 MB (WEB_INTEL_MAX_BYTES), 15 s timeout (WEB_INTEL_TIMEOUT), max 5 redirects.
WEB_INTEL_ALLOW_PRIVATE=1 disables the address check (tests only).
Tests
End-to-end with a fake KeyFlint quota gateway, locally signed licenses and a local test site (no network needed):
pip install -e ".[test]"
python -m pytest -q
License
Business Source License 1.1. Source available; production use needs a KeyFlint license (or must be non-commercial). Each version becomes Apache 2.0 four years after release. See LICENSE.
Web Intel MCP questions
How do I add Web Intel MCP to Claude Code?
Run claude mcp add --env 'KEYFLINT_LICENSE=<YOUR_KEYFLINT_LICENSE>' web-intel-mcp -- uvx web-intel-mcp in your terminal. Add --scope user to make it available in every project.
How do I add Web Intel MCP to Cursor?
Open ~/.cursor/mcp.json and add the server under mcpServers, using the Cursor config shown in the install section above.
How does the billing and refund system work?
The service uses a pay-per-call model via KeyFlint. If a fetch fails, credits are automatically refunded, and invalid inputs are rejected before any charges occur.
Can I customize the pricing for different tools?
Yes, you can override the default prices using the WEB_INTEL_PRICES environment variable.
How do I install it on Claude Desktop?
You can download the .mcpb file from the latest release, double-click it, and paste your license key for a one-click installation.