llm.energy MCP server
2026년 11월 15일 커밋웹사이트에서 llms.txt 및 install.md 문서를 추출하여 AI 클라이언트가 즉시 사용할 수 있는 구조화된 markdown 형식으로 변환합니다.
다른 이름 nirholas/extract-llms-docs, extract-llms-docs
- 스타
- 35
- Tools
- 9
- 다운로드, 30일
- —
- 최신 버전
- 1.0.0
- 마지막 커밋
- 2026년 11월 15일
- 라이선스
- —
llm.energy MCP란?
웹사이트에서 llms.txt 및 install.md 문서를 추출하여 AI 클라이언트가 즉시 사용할 수 있는 구조화된 markdown 형식으로 변환합니다. 9개 도구를 제공합니다. 예: extract_docs, validate_url, verify_llms_txt.
프로젝트 README에서 생성된 요약
llm.energy MCP server 정보
Documentation Extractor는 웹사이트 문서를 AI agent를 위한 구조화된 형식으로 변환합니다. 특히 llms.txt 및 install.md 표준을 구현한 웹사이트를 대상으로 하며, 원시 데이터를 agent가 바로 사용할 수 있는 markdown, JSON, YAML 또는 ZIP 아카이브로 변환합니다. 개발자는 이를 활용해 Cursor 또는 Windsurf와 같은 코딩 어시스턴트에 최신 컨텍스트를 제공할 수 있습니다.
사용자는 npx를 통해 Claude Desktop 또는 Cursor와 같은 클라이언트에 이 server를 연결합니다. 이 server는 agent가 기술 정보를 탐색하고 흡수할 수 있도록 extract_docs, validate_url, discover_documentation_urls 등 특화된 도구를 제공합니다. 또한 배치 처리 기능을 통해 여러 URL을 동시에 처리할 수 있습니다.
단순한 추출을 넘어, 이 시스템은 새로운 문서를 생성할 수도 있습니다. 공개 GitHub repository, 기존 문서 URL 또는 수동 입력을 분석하여 install.md 파일을 만드는 AI 기반 generator 기능을 갖추고 있습니다. 이는 외부 지식을 소비하거나 자신의 프로젝트를 AI 기반 워크플로우에 맞게 준비하는 데 매우 유용한 도구입니다.
활용 사례
- 1코딩 어시스턴트에 문서 제공Cursor 또는 Windsurf와 같은 AI 도구에 최신 기술 컨텍스트를 제공합니다.
- 2GitHub에서 설치 지침 생성공개 repository의 구조를 분석하여 실행 가능한 설치 파일을 생성합니다.
- 3RAG를 위한 문서 파이프라인 자동화검색 증강 생성(RAG) 시스템을 위해 문서를 수집하고 구조화하는 자동화된 워크플로우를 구축합니다.
- 4문서 표준 검증문서를 추출하기 전에 특정 웹사이트가 llms.txt 표준을 지원하는지 확인합니다.
프로젝트의 README를 바탕으로 작성되었습니다. 모든 활용 사례는 해당 내용의 인용문과 대조하여 확인합니다.
llm.energy MCP 도구 9
README에서 감지됨extract_docsvalidate_urlverify_llms_txtdiscover_documentation_urlslist_sitessearch_sitesfetch_llms_txtfetch_llms_full_txtextract_documentation
| extract_docs | — | |
| validate_url | — | |
| verify_llms_txt | — | |
| discover_documentation_urls | — | |
| list_sites | — | |
| search_sites | — | |
| fetch_llms_txt | — | |
| fetch_llms_full_txt | — | |
| extract_documentation | — |
자동 검사
2026년 11월 14일에 실행됨전체 보고서 →아직 인증되지 않았습니다. 서버는 80점 이상의 점수, 심각한 결함 없음, 그리고 검사에 충분한 데이터를 갖추어야 합니다. 검사 방식 · 점수를 높이기 위해 수정할 항목
- 소스 저장소 연결 및 접근 가능nirholas/extract-llms-docs is public and reachablegithub.com/nirholas/extract-llms-docs ↗통과
- 패키지가 이 저장소를 소스로 명시검사되지 않음
- 빌드 출처(Sigstore 증명)검사되지 않음
- 오픈 소스 라이선스 (OSI)No license결함 발견
- 최근 1년 내 커밋 또는 릴리스Last commit or release 2026-11-13github.com/nirholas/extract-llms-docs ↗통과
- OpenSSF Scorecard검사되지 않음
- 패키지 이름이 인기 패키지와 유사하지 않음검사되지 않음
- 패키지 및 해당 종속성에 중요한 보안 권고 없음검사되지 않음
- 모델에 대한 숨겨진 지침 없음9 tool descriptions and the README read; no override phrases, credential paths or hidden characters통과
- 파괴적인 도구에 라벨 표시됨No tool named like delete, drop or exec통과
- 원격 엔드포인트가 MCP 핸드셰이크에 응답검사되지 않음
README
GitHub에서 보기llm.energy
📖 Overview
llm.energy is a web application and MCP server that fetches, parses, and organizes documentation from websites implementing the llms.txt and install.md standards. It transforms raw documentation into structured, agent-ready formats optimized for large language models, AI assistants, and developer tooling.
| Standard | Description | Learn More |
|---|---|---|
| llms.txt | Machine-readable documentation for AI systems | llmstxt.org |
| install.md | LLM-executable installation instructions | installmd.org |
✨ Key Features
| Feature | Description |
|---|---|
| 🔍 Smart Detection | Automatically finds llms.txt, llms-full.txt, and install.md |
| 📄 Organized Output | Splits content into individual markdown files by section |
| 🤖 Agent-Ready | Includes AGENT-GUIDE.md optimized for AI assistants |
| 📦 Multiple Formats | Export as Markdown, JSON, YAML, or ZIP archive |
| 🔌 MCP Server | Integrate with Claude Desktop, Cursor, and more |
| ⚡ Batch Processing | Process multiple URLs simultaneously |
| 📚 Site Directory | Browse 19+ curated llms.txt-enabled websites |
| ✏️ llms.txt Generator | Create your own llms.txt files with a guided wizard |
| 🚀 install.md Generator | AI-powered: generate from GitHub repos, docs URLs, or manually |
🎯 Use Cases
─────────────────────────────────────────────────────────────────
📝 Feed docs to AI coding assistants (Cursor, Windsurf)
🤖 Build context-aware AI agents with up-to-date docs
🔄 Create documentation pipelines for RAG systems
📦 Aggregate docs from multiple sources automatically
✏️ Generate llms.txt/install.md for your own projects
🚀 Auto-generate install.md from any GitHub repo
─────────────────────────────────────────────────────────────────
🚀 install.md Generator
Generate LLM-executable installation instructions from any source:
| Mode | Description | Use Case |
|---|---|---|
| From GitHub | Analyze any public GitHub repo and generate install.md | Perfect for creating install.md for existing projects |
| From URL | Extract from any documentation page | Convert existing docs to install.md format |
| Manual | Build from scratch with guided wizard | Full control over every detail |
How It Works
- GitHub Mode: Analyzes README, package.json/pyproject.toml/Cargo.toml, GitHub Actions, and releases
- URL Mode: Scrapes documentation pages, detects platforms (Mintlify, Docusaurus, GitBook, etc.)
- AI Synthesis: Uses Claude to generate a properly formatted install.md
Quick Example
# Generate install.md for any GitHub project
curl -X POST https://llm.energy/api/generate-install \
-H "Content-Type: application/json" \
-d '{"url": "https://github.com/anthropics/anthropic-sdk-python", "type": "github"}'
Visit llm.energy/install-generator to use the web interface.
📚 Documentation
Full documentation is available at llm.energy/docs
🚀 Installation
Web Application
Visit llm.energy to use the hosted version.
Local Development
# Clone the repository
git clone https://github.com/nirholas/extract-llms-docs.git
cd extract-llms-docs
# Install dependencies
pnpm install
# Start development server
pnpm dev
🌐 The application runs on http://localhost:3001
MCP Server
Add to your MCP client configuration (Claude Desktop, Cursor, etc.):
{
"mcpServers": {
"llm-energy": {
"command": "npx",
"args": ["-y", "@llm-energy/mcp-server"]
}
}
}
See MCP Server Documentation for detailed setup.
🔌 API Reference
curl -X POST https://llm.energy/api/extract \
-H "Content-Type: application/json" \
-d '{"url": "docs.anthropic.com"}'
Response includes parsed sections, metadata, and download URLs.
curl -X POST https://llm.energy/api/validate \
-H "Content-Type: application/json" \
-d '{"url": "docs.example.com"}'
curl -X POST https://llm.energy/api/batch \
-H "Content-Type: application/json" \
-d '{"urls": ["docs.anthropic.com", "docs.stripe.com"]}'
# Formats: markdown, json, yaml, zip
curl "https://llm.energy/api/download?url=docs.anthropic.com&format=zip"
# Generate from a GitHub repository
curl -X POST https://llm.energy/api/generate-install \
-H "Content-Type: application/json" \
-d '{"url": "https://github.com/anthropics/anthropic-sdk-python", "type": "github"}'
# Generate from a documentation URL
curl -X POST https://llm.energy/api/generate-install \
-H "Content-Type: application/json" \
-d '{"url": "https://docs.anthropic.com/en/docs/quickstart", "type": "docs"}'
# Analyze only (preview mode)
curl "https://llm.energy/api/generate-install?url=https://github.com/anthropics/anthropic-sdk-python&type=github"
🤖 MCP Server Tools
The MCP server exposes the following tools for AI agents:
| Tool | Description |
|---|---|
extract_docs |
Extract documentation from a URL with llms.txt support |
validate_url |
Check if a URL has llms.txt available |
verify_llms_txt |
Verify llms.txt exists and get file info |
discover_documentation_urls |
Find documentation URLs for a domain |
list_sites |
Get directory of known llms.txt-enabled sites |
search_sites |
Search the site directory by category or keyword |
🏗️ Architecture
┌──────────────────────────────────────────────────────────────────┐
│ llm.energy │
├──────────────────────────────────────────────────────────────────┤
│ │
│ ┌─────────────┐ ┌─────────────┐ ┌─────────────┐ │
│ │ Web App │ │ REST API │ │ MCP Server │ │
│ │ (Next.js) │ │ /api/* │ │ (stdio) │ │
│ └──────┬──────┘ └──────┬──────┘ └──────┬──────┘ │
│ │ │ │ │
│ └────────────────┼────────────────┘ │
│ │ │
│ ┌──────▼──────┐ │
│ │ Core │ │
│ │ - Parser │ │
│ │ - Extractor│ │
│ │ - Cache │ │
│ └──────┬──────┘ │
│ │ │
│ ┌────────────────┼────────────────┐ │
│ ▼ ▼ ▼ │
│ ┌─────────────┐ ┌─────────────┐ ┌─────────────┐ │
│ │ llms.txt │ │ install.md │ │ Sitemap │ │
│ └─────────────┘ └─────────────┘ └─────────────┘ │
│ │
└──────────────────────────────────────────────────────────────────┘
extract-llms-docs/
├── src/
│ ├── app/ # Next.js pages and API routes
│ │ ├── api/ # REST API endpoints
│ │ │ ├── extract/ # Documentation extraction API
│ │ │ ├── generate-install/ # AI-powered install.md generation
│ │ │ └── ... # Other API endpoints
│ │ ├── extract/ # Extraction interface
│ │ ├── batch/ # Batch processing page
│ │ ├── directory/ # Site directory browser
│ │ ├── generator/ # llms.txt generator wizard
│ │ └── install-generator/ # install.md generator with tabs
│ ├── components/ # React UI components
│ │ └── install-generator/ # GitHubTab, UrlTab, Preview
│ ├── lib/ # Core utilities
│ │ ├── github-analyzer.ts # GitHub repo analysis
│ │ ├── docs-analyzer.ts # Documentation URL scraping
│ │ └── ... # Parser, extractor, cache
│ ├── hooks/ # React hooks
│ └── types/ # TypeScript definitions
├── packages/core/ # Shared parser and types
├── mcp-server/ # MCP server package
└── docs-site/ # MkDocs documentation source
🛠️ Technology Stack
⚙️ Configuration
All environment variables are optional — the app runs without them. Copy .env.example to
.env.local and fill in only what you need:
cp .env.example .env.local
| Variable | Used by | Default | Purpose |
|---|---|---|---|
ADMIN_KEY |
/api/cache |
unset | Value the x-admin-key header must match for cache management. Both GET and POST return 500 when it is unset. Production reads it from Secret Manager (llm-energy-admin-key). |
ANTHROPIC_API_KEY |
/api/generate-install |
unset | Enables Claude-backed generation of install.md. The endpoint returns a configuration error without it. |
VERIFY_TIMEOUT_MS |
/api/sites/verify |
10000 |
Per-site fetch timeout, in milliseconds. |
VERIFY_CACHE_TTL_MS |
/api/sites/verify |
300000 |
How long verification results are cached, in milliseconds. |
HEALTH_TIMEOUT_MS |
/api/sites/health |
8000 |
Timeout for site health probes, in milliseconds. |
🚀 Deployment
| Hostname | Serves | Hosted on |
|---|---|---|
llm.energy, www.llm.energy |
The Next.js app and its /api/* routes |
Cloud Run service llm-energy, fronted by the Cloudflare Worker llm-energy-proxy |
| docs.llm.energy | MkDocs site built from docs-site/ |
Cloudflare Pages project llm-energy |
Redeploy commands, DNS layout and rollback: docs/deploy-cloudflare.md.
💻 Development
pnpm dev # 🚀 Start development server
pnpm build # 📦 Production build
pnpm start # ▶️ Start production server
pnpm test # 🧪 Run tests (163 tests)
pnpm test:coverage # 📊 Tests with coverage report
pnpm typecheck # ✅ TypeScript validation
pnpm lint # 🔍 ESLint check
🔗 Related Projects
| Project | Description |
|---|---|
| llms.txt Standard | Machine-readable documentation format |
| install.md Standard | LLM-executable installation format |
| Model Context Protocol | Protocol for AI tool integration |
| MCP Servers Directory | Community MCP servers |
🌐 Sites with llms.txt Support
Browse 19+ curated websites with verified llms.txt support at llm.energy/directory
Featured sites include:
- 🤖 Anthropic Documentation
- ⚡ Vercel Documentation
- 💳 Stripe API Reference
- 🗄️ Supabase Docs
- 📘 Mintlify Documentation
- ...and more!
🤝 Contributing
Contributions are welcome! Please follow these steps:
- 🍴 Fork the repository
- 🌿 Create a feature branch (
git checkout -b feature/amazing-feature) - 💾 Commit your changes (
git commit -m 'Add amazing feature') - 📤 Push to the branch (
git push origin feature/amazing-feature) - 🔀 Open a Pull Request
Adding a site to the directory? Edit src/data/sites.ts and submit a PR.
📄 License
Proprietary — Copyright 2026 nirholas, all rights reserved. See LICENSE for details.
🔗 Links
👤 Author
Built by nich
Author
Built by nich - https://x.com/nichxbt
Comprehensive keyword list for ERC-8004 Trustless Agents ecosystem
Core Protocol Keywords
ERC-8004, ERC8004, EIP-8004, EIP8004, Trustless Agents, trustless agent, trustless AI, trustless AI agents, agent protocol, agent standard, Ethereum agent standard, blockchain agent protocol, on-chain agents, onchain agents, on-chain AI, onchain AI, decentralized agents, decentralized AI agents, autonomous agents, autonomous AI agents, AI agent protocol, AI agent standard, agent discovery, agent trust, agent reputation, agent validation, agent identity, agent registry, identity registry, reputation registry, validation registry, agent NFT, ERC-721 agent, agent tokenId, agentId, agentURI, agentWallet, agent registration, agent registration file, agent-registration.json, agent card, agent metadata, agent endpoints, agent discovery protocol, agent trust protocol, open agent protocol, open agent standard, permissionless agents, permissionless AI, censorship-resistant agents, portable agent identity, portable AI identity, verifiable agents, verifiable AI agents, accountable agents, accountable AI, agent accountability
Blockchain & Web3 Keywords
Ethereum, Ethereum mainnet, ETH, EVM, Ethereum Virtual Machine, smart contracts, Solidity, blockchain, decentralized, permissionless, trustless, on-chain, onchain, L2, Layer 2, Base, Optimism, Polygon, Linea, Arbitrum, Scroll, Monad, Gnosis, Celo, Sepolia, testnet, mainnet, singleton contracts, singleton deployment, ERC-721, NFT, non-fungible token, tokenURI, URIStorage, EIP-712, ERC-1271, wallet signature, EOA, smart contract wallet, gas fees, gas sponsorship, EIP-7702, subgraph, The Graph, indexer, blockchain indexing, IPFS, decentralized storage, content-addressed, immutable data, public registry, public good, credibly neutral, credibly neutral infrastructure, open protocol, open standard, Web3, crypto, cryptocurrency, DeFi, decentralized finance
AI & Agent Technology Keywords
AI agents, artificial intelligence agents, autonomous AI, AI autonomy, LLM agents, large language model agents, machine learning agents, ML agents, AI assistant, AI chatbot, intelligent agents, software agents, digital agents, virtual agents, AI automation, automated agents, agent-to-agent, A2A, A2A protocol, Google A2A, Agent2Agent, MCP, Model Context Protocol, agent communication, agent interoperability, agent orchestration, agent collaboration, multi-agent, multi-agent systems, agent capabilities, agent skills, agent tools, agent prompts, agent resources, agent completions, AgentCard, agent card, agent endpoint, agent service, AI service, AI API, agent API, AI infrastructure, agent infrastructure, agentic, agentic web, agentic economy, agentic commerce, agent economy, agent marketplace, AI marketplace, agent platform, AI platform
Trust & Reputation Keywords
trust, trustless, reputation, reputation system, reputation protocol, reputation registry, feedback, client feedback, user feedback, on-chain feedback, on-chain reputation, verifiable reputation, portable reputation, reputation aggregation, reputation scoring, reputation algorithm, trust signals, trust model, trust verification, trust layer, recursive reputation, reviewer reputation, spam prevention, Sybil attack, Sybil resistance, anti-spam, feedback filtering, trusted reviewers, rating, rating system, quality rating, starred rating, uptime rating, success rate, response time, performance history, track record, audit trail, immutable feedback, permanent feedback, feedback response, appendResponse, giveFeedback, revokeFeedback, feedback tags, feedback value, valueDecimals, feedbackURI, feedbackHash, clientAddress, reviewer address
Validation & Verification Keywords
validation, validation registry, validator, validator contract, cryptographic validation, cryptographic proof, cryptographic attestation, zero-knowledge, ZK, zkML, zero-knowledge machine learning, ZK proofs, trusted execution environment, TEE, TEE attestation, TEE oracle, stake-secured, staking validators, crypto-economic security, inference re-execution, output validation, work verification, third-party validation, independent validation, validation request, validation response, validationRequest, validationResponse, requestHash, responseHash, verifiable computation, verified agents, verified behavior, behavioral validation, agent verification
Payment & Commerce Keywords
x402, x402 protocol, x402 payments, programmable payments, micropayments, HTTP payments, pay-per-request, pay-per-task, agent payments, AI payments, agent monetization, AI monetization, agent commerce, AI commerce, agentic commerce, agent economy, AI economy, agent marketplace, service marketplace, agent-to-agent payments, A2A payments, stablecoin payments, USDC, crypto payments, on-chain payments, payment settlement, programmable settlement, proof of payment, proofOfPayment, payment receipt, payment verification, Coinbase, Coinbase x402, agent pricing, API pricing, service pricing, subscription, API keys, revenue, trading yield, cumulative revenues, agent wallet, payment address, toAddress, fromAddress, txHash
Discovery & Registry Keywords
agent discovery, service discovery, agent registry, identity registry, agent registration, register agent, mint agent, agent NFT, agent tokenId, agent browsing, agent explorer, agent scanner, 8004scan, 8004scan.io, agentscan, agentscan.info, 8004agents, 8004agents.ai, agent leaderboard, agent ranking, top agents, agent listing, agent directory, agent catalog, agent index, browse agents, search agents, find agents, discover agents, agent visibility, agent discoverability, no-code registration, agent creation, create agent, my agents, agent owner, agent operator, agent transfer, transferable agent, portable agent
Endpoints & Integration Keywords
endpoint, agent endpoint, service endpoint, API endpoint, MCP endpoint, A2A endpoint, web endpoint, HTTPS endpoint, HTTP endpoint, DID, decentralized identifier, ENS, Ethereum Name Service, ENS name, agent.eth, vitalik.eth, email endpoint, OASF, Open Agent Specification Format, endpoint verification, domain verification, endpoint ownership, .well-known, well-known, agent-registration.json, endpoint domain, endpoint URL, endpoint URI, base64 data URI, on-chain metadata, off-chain metadata, metadata storage, JSON metadata, agent JSON, registration JSON
SDK & Developer Tools Keywords
SDK, Agent0 SDK, Agent0, ChaosChain SDK, ChaosChain, Lucid Agents, Daydreams AI, create-8004-agent, npm, TypeScript SDK, Python SDK, JavaScript, Solidity, smart contract, ABI, contract ABI, deployed contracts, contract addresses, Hardhat, development tools, developer tools, dev tools, API, REST API, GraphQL, subgraph, The Graph, indexer, blockchain explorer, Etherscan, contract verification, open source, MIT license, CC0, public domain, GitHub, repository, code repository, documentation, docs, best practices, reference implementation
Ecosystem & Community Keywords
ecosystem, community, builder, builders, developer, developers, contributor, contributors, partner, partners, collaborator, collaborators, co-author, co-authors, MetaMask, Ethereum Foundation, Google, Coinbase, Consensys, AltLayer, Virtuals Protocol, Olas, EigenLayer, Phala, ElizaOS, Flashbots, Polygon, Base, Optimism, Arbitrum, Scroll, Linea, Monad, Gnosis, Celo, Near Protocol, Filecoin, Worldcoin, ThirdWeb, ENS, Collab.land, DappRadar, Giza Tech, Theoriq, OpenServ, Questflow, Semantic, Semiotic, Cambrian, Nevermined, Oasis, Towns Protocol, Warden Protocol, Terminal3, Pinata Cloud, Silence Labs, Rena Labs, Index Network, Trusta Network, Turf Network
Key People & Organizations Keywords
Marco De Rossi, MetaMask AI Lead, Davide Crapis, Ethereum Foundation AI, Head of AI, Jordan Ellis, Google engineer, Erik Reppel, Coinbase engineering, Head of Engineering, Sumeet Chougule, ChaosChain founder, YQ, AltLayer co-founder, Wee Kee, Virtuals contributor, Cyfrin audit, Nethermind audit, Ethereum Foundation Security Team, security audit, audited contracts
llm.energy MCP 질문
llm.energy MCP는 어떤 도구를 제공하나요?
9개 도구를 제공합니다. 예: extract_docs, validate_url, verify_llms_txt, discover_documentation_urls, list_sites.
llm.energy는 웹사이트에서 무엇을 추출하나요?
해당 표준을 구현한 사이트에서 llms.txt, llms-full.txt, install.md 파일을 가져와 구조화된 markdown으로 정리합니다.
llm.energy MCP server는 어떤 MCP 도구를 제공하나요?
이 server는 extract_docs, validate_url, verify_llms_txt, discover_documentation_urls, list_sites, search_sites와 같은 도구를 제공합니다.
llm.energy MCP server를 클라이언트에 어떻게 추가하나요?
클라이언트 설정에 npx -y @llm-energy/mcp-server를 실행하는 llm-energy라는 이름의 mcpServers 항목을 추가하세요.
llm.energy는 여러 URL을 동시에 처리할 수 있나요?
네, batch API를 통해 URL 목록을 받아 한꺼번에 처리할 수 있으며, export 형식으로는 markdown, JSON, YAML, ZIP을 지원합니다.
제 프로젝트를 위한 install.md를 생성할 수 있나요?
네, install.md generator를 사용하여 공개 GitHub repo를 분석하거나, docs URL을 스크래핑하거나, 수동으로 생성할 수 있습니다.