Decodo Web Scraping API를 통해 AI agent가 웹 페이지 스크래핑, 검색 실행, 사이트 크롤링, eCommerce 및 소셜 미디어 데이터를 수집할 수 있습니다.
다른 이름 Decodo/mcp-server, @decodo/mcp-server
- 스타
- 41
- Tools
- 33
- 다운로드, 30일
- 2,738
- 최신 버전
- 1.7.0
- 마지막 커밋
- 2026년 11월 10일
- 라이선스
- —
Decodo MCP란?
Decodo Web Scraping API를 통해 AI agent가 웹 페이지 스크래핑, 검색 실행, 사이트 크롤링, eCommerce 및 소셜 미디어 데이터를 수집할 수 있습니다. 33개 도구를 제공합니다. 예: scrape_as_markdown, screenshot, map.
프로젝트 README에서 생성된 요약
Decodo MCP server 정보
이 server는 Claude, Cursor, Windsurf와 같은 도구를 사용하는 개발자가 AI agent를 실시간 웹 데이터에 연결할 수 있도록 지원합니다. Decodo Web Scraping API와 통합함으로써 LLM이 별도의 스크래핑 인프라, 프록시 관리 또는 CAPTCHA 해결 과정을 거칠 필요가 없게 합니다. 사용자는 표준화된 인터페이스를 통해 검색 엔진, 소셜 미디어 플랫폼 및 주요 eCommerce 사이트에서 정보를 가져올 수 있습니다.
설정에는 Decodo API key와 호환되는 MCP client가 필요합니다. server는 Node.js를 통해 로컬에서 실행하거나 호스팅된 URL에 연결할 수 있습니다. RAG 파이프라인과 자동화된 리서치를 지원하기 위해 Markdown, JSON 또는 스크린샷 형식의 구조화된 데이터를 제공합니다. 개발자는 agent 성능을 최적화하고 사용 가능한 도구 범위를 제한하기 위해 web, search, ecommerce, social_media 또는 ai와 같은 특정 toolsets를 선택할 수 있습니다.
활용 사례
- 1실시간 RAG 통합Google 또는 Bing 검색 결과의 실시간 데이터를 retrieval-augmented generation 파이프라인에 제공합니다.
- 2자동화된 eCommerce 인텔리전스Amazon, Walmart, Target과 같은 마켓플레이스의 제품 목록과 가격을 추적합니다.
- 3소셜 미디어 데이터 수집YouTube 및 TikTok에서 참여 지표와 콘텐츠를 수집합니다.
- 4동적 웹사이트 스크래핑프록시 로테이션이나 안티 봇 시스템을 관리하지 않고도 JavaScript가 많은 웹사이트에서 콘텐츠를 추출합니다.
프로젝트의 README를 바탕으로 작성되었습니다. 모든 활용 사례는 해당 내용의 인용문과 대조하여 확인합니다.
Decodo MCP 설치 방법
형식 확인: 2026년 11월 10일Cursor에 추가Goose에 추가Claude Code에 Decodo MCP 설치
$ claude mcp add mcp-server -- npx -y @decodo/mcp-serverCursor에 Decodo MCP 설치
~/.cursor/mcp.json
{
"mcpServers": {
"mcp-server": {
"command": "npx",
"args": [
"-y",
"@decodo/mcp-server"
]
}
}
}VS Code에 Decodo MCP 설치
.vscode/mcp.json
{
"servers": {
"mcp-server": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"@decodo/mcp-server"
]
}
}
}VS Code CLI에 Decodo MCP 설치
$ code --add-mcp '{"name":"mcp-server","type":"stdio","command":"npx","args":["-y","@decodo/mcp-server"]}'Claude Desktop에 Decodo MCP 설치
claude_desktop_config.json
{
"mcpServers": {
"mcp-server": {
"command": "npx",
"args": [
"-y",
"@decodo/mcp-server"
]
}
}
}Codex에 Decodo MCP 설치
$ codex mcp add mcp-server -- npx -y @decodo/mcp-serverCodex config.toml에 Decodo MCP 설치
~/.codex/config.toml
[mcp_servers.mcp-server] command = "npx" args = ["-y", "@decodo/mcp-server"]
Gemini CLI에 Decodo MCP 설치
$ gemini mcp add -s user mcp-server npx -- -y @decodo/mcp-serverGemini settings.json에 Decodo MCP 설치
~/.gemini/settings.json
{
"mcpServers": {
"mcp-server": {
"command": "npx",
"args": [
"-y",
"@decodo/mcp-server"
]
}
}
}Decodo MCP 도구 33
README에서 감지됨scrape_as_markdownscreenshotmapcrawl_startcrawl_statuscrawl_resultscrawl_cancelsearchgoogle_searchgoogle_adsgoogle_lensgoogle_ai_mode
| scrape_as_markdown | — | |
| screenshot | — | |
| map | — | |
| crawl_start | — | |
| crawl_status | — | |
| crawl_results | — | |
| crawl_cancel | — | |
| search | — | |
| google_search | — | |
| google_ads | — | |
| google_lens | — | |
| google_ai_mode | — |
도구 33개 모두 보기도구 수 줄이기
google_travel_hotelsamazon_searchamazon_productamazon_pricingamazon_sellersamazon_bestsellerswalmart_searchwalmart_producttarget_searchtarget_producttiktok_posttiktok_shop_searchtiktok_shop_producttiktok_shop_urlyoutube_metadatayoutube_channelyoutube_subtitlesyoutube_searchbing_searchchatgptperplexity
| google_travel_hotels | — | |
| amazon_search | — | |
| amazon_product | — | |
| amazon_pricing | — | |
| amazon_sellers | — | |
| amazon_bestsellers | — | |
| walmart_search | — | |
| walmart_product | — | |
| target_search | — | |
| target_product | — | |
| tiktok_post | — | |
| tiktok_shop_search | — | |
| tiktok_shop_product | — | |
| tiktok_shop_url | — | |
| youtube_metadata | — | |
| youtube_channel | — | |
| youtube_subtitles | — | |
| youtube_search | — | |
| bing_search | — | |
| chatgpt | — | |
| perplexity | — |
구성
SCRAPER_API_TOKEN
| 이름 | 설명 | 유형 |
|---|---|---|
| SCRAPER_API_TOKEN | — |
자동 검사
2026년 11월 12일에 실행됨전체 보고서 →자동 검사를 통과했습니다. 이는 보안 감사가 아닙니다. 코드를 직접 읽고 서버에 필요한 최소한의 권한만 부여하십시오. 검사 방식 · 점수를 높이기 위해 수정할 항목
- 소스 저장소 연결 및 접근 가능통과
- 오픈 소스 라이선스 (OSI)No license결함 발견
- 최근 1년 내 커밋 또는 릴리스통과
- 패키지 이름이 인기 패키지와 유사하지 않음통과
- 원격 엔드포인트가 HTTPS 사용검사되지 않음
- 파괴적인 도구에 라벨 표시됨통과
- 모델에 대한 숨겨진 지침 없음통과
- 패키지 및 해당 종속성에 중요한 보안 권고 없음통과
README
GitHub에서 보기Decodo MCP Server
Connect LLMs and AI agents to live web data using MCP (Model Context Protocol). The Decodo MCP Server lets you scrape websites, search engines, eCommerce platforms, and social media directly from AI tools like Claude, Cursor, and Windsurf, all without the need to build scraping infrastructure from scratch.
- Structured outputs in JSON, Markdown, and screenshots
- Server-side JavaScript rendering and anti-bot handling
- 125M+ IPs across 195+ locations
What is Decodo MCP server?
The Decodo MCP Server is a web scraping layer for AI agents. It connects MCP-compatible clients to Decodo's Web Scraping API, enabling:
- Web scraping for LLMs
- Real-time data retrieval for RAG
- AI agent browsing and research
- Structured data extraction from dynamic websites
Instead of maintaining proxies, parsers, and retry logic, you get a single integration point for reliable web data access.
Why use MCP for web scraping?
Model Context Protocol (MCP) is the emerging standard for connecting AI agents to external tools and data sources. With MCP:
- Agents can call tools dynamically
- Integrations stay standardized
- Workflows scale across environments
The Decodo MCP Server gives your agents reliable, production-ready web access through this standard.
Key features
Web scraping for AI agents, no infrastructure required. Scrape any website, including JavaScript-heavy pages, without handling proxy rotation, CAPTCHA solving, or anti-bot systems.
Structured outputs for LLM workflows. Markdown (LLM-ready), JSON (for structured pipelines), and screenshots (for visual context), built for RAG pipelines, AI research agents, and automation flows.
Built-in support for popular targets. Ready-made tools for Google and Bing (SERPs), Amazon, Walmart, and Target (eCommerce), TikTok and YouTube (social media), and ChatGPT and Perplexity (AI search).
Global proxy infrastructure. 115M+ residential IPs, 195+ geo-locations, and a 99.99% success rate on even the most protected targets.
Modular MCP toolsets. Enable only what you need: web, search, ecommerce, social_media,
ai for cleaner tool selection and better agent performance.
Fast time to value. From API key to first scrape in minutes, no setup overhead.
Use cases
Use the Decodo MCP Server when you need web scraping for AI agents, structured data extraction at scale, reliable access to dynamic websites, real-time data for RAG, or an alternative to building scraping infrastructure from scratch. Common scenarios:
- AI-powered web scraping – give LLMs the ability to collect fresh data instead of relying on static training data.
- RAG with live data – pull real-time Google, Bing, and AI search results into retrieval pipelines.
- eCommerce intelligence – track product prices, listings, and sellers across marketplaces without getting blocked.
- Social media data collection – gather posts, channels, and engagement data from TikTok and YouTube.
- Travel and price aggregation – build tools that collect live pricing and availability across websites.
Quick start
- Create a free account at dashboard.decodo.com – up to 10K free requests, no credit card required.
- Get your API key. Copy your Web Data API key from your Web Data API subscription on the dashboard. Older plans have a basic authentication token, which also works (see Authentication).
- Download Node.js 18+ from https://nodejs.org.
- Get MCP client like Claude Desktop, Cursor, Windsurf or other MCP-compatible tools.
- Configure the MCP server in your AI client (see configuration examples below).
Connecting to Decodo's MCP server
Open your preferred MCP client and add the following configuration (see examples for Claude Code, Cursor, Windsurf bellow):
{
"mcpServers": {
"Decodo": {
"url": "https://mcp.decodo.com/mcp",
"headers": {
"Authorization": "Bearer <api_key>"
}
}
}
}
Authentication
| Credential | Where to get it | Hosted server header | Local server env |
|---|---|---|---|
| API key (recommended) | Web Data API subscription on the dashboard | Authorization: Bearer <api_key> |
SCRAPER_API_TOKEN=<api_key> |
| Basic authentication token (older plans) | Web Scraping API page on the dashboard | Authorization: Basic <basic_auth_token> |
SCRAPER_API_TOKEN=<basic_auth_token> |
The local server reads either credential from SCRAPER_API_TOKEN and works out which one it got.
Claude Desktop
- Open Claude Desktop → Settings → Developer → Edit Config.
- Add to claude_desktop_config.json:
{
"mcpServers": {
"Decodo": {
"command": "npx",
"args": ["-y", "@decodo/mcp-server"],
"env": {
"SCRAPER_API_TOKEN": "<api_key>",
"TOOLSETS": "web,ai"
}
}
}
}
- Save and restart Claude Desktop.
Cursor
- Open Settings → MCP.
- Click Add a new global MCP server (opens mcp.json).
- Add the same configuration as above.
- Save — look for a green status indicator next to Decodo.
Windsurf
- Open Settings → Windsurf Settings.
- Scroll to Cascade → Add custom server + (opens mcp_config.json).
- Add the same configuration as above.
- Save and restart Windsurf.
eve (Vercel)
- In your eve agent project, run
eve add connection/decodo, or createagent/connections/decodo.ts:
import { always } from 'eve/tools/approval';
import { defineMcpClientConnection } from 'eve/connections';
export default defineMcpClientConnection({
url: 'https://mcp.decodo.com/mcp',
description:
'Decodo: scrape web pages as Markdown, search the web, map and crawl sites, and read e-commerce and YouTube data.',
headers: () => ({
Authorization: `Bearer ${process.env.DECODO_API_KEY!}`,
}),
approval: always(),
});
- Set
DECODO_API_KEY=<api_key>in the agent's server-side environment (.env.locallocally, project env vars on Vercel). approval: always()asks before every call, since calls use your plan; relax it with eve's approval rules if you prefer.
Test your setup
Once connected, try this prompt in your client:
▎ "Scrape the titles of the top 5 articles from Hacker News"
You should get a structured list back within seconds. If you see an auth error, double-check your API key on the dashboard.
Local development
Only needed if you want to change the server code.
Prerequisites
- Node.js 18.0+
- An MCP client - popular choices are Claude Desktop and Cursor
Step-by-step guide
- Clone this repository:
git clone https://github.com/Decodo/mcp-server
- Run the following commands in the terminal:
cd mcp-server
npm install
npm run build
- Take note of your build location:
cd build/
pwd
Adding index.js to the end of this directory, your build file location should look something like
this:
/Users/your.user/projects/mcp-server/build/index.js
- Update your MCP client with the server information:
{
"mcpServers": {
"decodo-mcp": {
"command": "node",
"args": ["/Users/your.user/projects/mcp-server/build/index.js"],
"env": {
"SCRAPER_API_TOKEN": "<api_key>"
}
}
}
}
Toolsets
Tools are organized into toolsets. Which ones you get depends on how you connect.
Claude (official connector)
The Decodo connector in Claude's connector directory includes the Web Data API tools only:
| Toolset | Tools |
|---|---|
web |
scrape_as_markdown, screenshot, map, crawl_start, crawl_status, crawl_results, crawl_cancel |
search |
search |
Any MCP client
You can selectively enable specific toolsets by passing a comma-separated list via the toolsets
query parameter:
"Decodo MCP Server": {
"url": "https://mcp.decodo.com/mcp?toolsets=web,ai",
"headers": {
"Authorization": "Bearer <api_key>"
}
}
When no toolsets are specified, all tools are registered.
| Toolset | Tools |
|---|---|
web |
scrape_as_markdown, screenshot, map, crawl_start, crawl_status, crawl_results, crawl_cancel |
search |
search, google_search, google_ads, google_lens, google_travel_hotels, bing_search |
ecommerce |
amazon_search, amazon_product, amazon_pricing, amazon_sellers, amazon_bestsellers, walmart_search, walmart_product, target_search, target_product, tiktok_shop_search, tiktok_shop_product, tiktok_shop_url |
social_media |
tiktok_post, youtube_metadata, youtube_channel, youtube_subtitles, youtube_search |
ai |
chatgpt, perplexity, google_ai_mode |
Tools
The server exposes the following tools:
| Tool | Description | Example prompt |
|---|---|---|
scrape_as_markdown |
Scrapes any target URL, expects a URL to be given via prompt. Returns results in Markdown. | Scrape peacock.com from a US IP address and tell me the pricing. |
screenshot |
Captures a screenshot of any webpage and returns it as a PNG image. | Take a screenshot of github.com from a US IP address. |
map |
Lists the URLs on a website without fetching their content. API key only. | Map docs.decodo.com and list the pages under /scraping-api. |
crawl_start |
Starts crawling a website and returns the crawl id without waiting. API key only. | Crawl the first 10 pages of decodo.com/blog. |
crawl_status |
Reports a crawl's progress: pages discovered, completed and failed. API key only. | Is my crawl finished yet? |
crawl_results |
Returns crawled pages as Markdown, a few at a time with a cursor. API key only. | Show me the pages my crawl found. |
crawl_cancel |
Stops a running crawl; pages crawled so far stay readable. API key only. | Cancel my crawl. |
search |
Searches the web and returns ranked results. API key only. | Search the web for MCP server hosting options. |
google_search |
Scrapes Google Search for a given query, and returns parsed results. | Scrape Google Search for shoes and tell me the top position. |
google_ads |
Scrapes Google Ads search results. | Scrape Google Ads for laptop and show me the top ads. |
google_lens |
Scrapes Google Lens image search results. | Search Google Lens for this image: https://example.com/image.jpg |
google_ai_mode |
Scrapes Google AI Mode (Search with AI) results. | Ask Google AI Mode: What are the top three dog breeds? |
google_travel_hotels |
Scrapes Google Travel Hotels search results. | Search Google Travel Hotels for hotels in Paris. |
amazon_search |
Scrapes Amazon Search for a given query, and returns parsed results. | Scrape Amazon Search for wireless keyboard. |
amazon_product |
Scrapes Amazon Product page. | Scrape Amazon product B09H74FXNW and show me the details. |
amazon_pricing |
Scrapes Amazon Product pricing information. | Get pricing for Amazon product B09H74FXNW. |
amazon_sellers |
Scrapes Amazon Seller information. | Get information about Amazon seller A1R0Z7FJGTKESH. |
amazon_bestsellers |
Scrapes Amazon Bestsellers list. | Show me Amazon bestsellers in electronics. |
walmart_search |
Scrapes Walmart Search for a given query, and returns parsed results. | Scrape Walmart Search for camping tent. |
walmart_product |
Scrapes Walmart Product page. | Scrape Walmart product 15296401808. |
target_search |
Scrapes Target Search for a given query, and returns parsed results. | Scrape Target Search for kitchen appliances. |
target_product |
Scrapes Target Product page. | Scrape Target product 92186007. |
tiktok_post |
Scrapes a TikTok post URL for structured data (e.g. engagement, caption, hashtags). | Scrape this TikTok post: https://www.tiktok.com/@nba/video/7393013274725403950 |
tiktok_shop_search |
Scrapes TikTok Shop Search for a given query, and returns parsed results. | Scrape TikTok Shop Search for phone cases. |
tiktok_shop_product |
Scrapes TikTok Shop Product page. | Scrape TikTok Shop product 1731541214379741272. |
tiktok_shop_url |
Scrapes TikTok Shop page by URL. | Scrape this TikTok Shop URL: https://www.tiktok.com/shop/s?q=HEADPHONES |
youtube_metadata |
Scrapes YouTube video metadata. | Get metadata for YouTube video dFu9aKJoqGg. |
youtube_channel |
Scrapes YouTube channel videos. | Scrape YouTube channel @decodo_official. |
youtube_subtitles |
Scrapes YouTube video subtitles. | Get subtitles for YouTube video L8zSWbQN-v8. |
youtube_search |
Search YouTube videos. | Search YouTube for "How to care for chinchillas". |
bing_search |
Scrapes Bing Search results. | Search Bing for laptop reviews. |
chatgpt |
Sends a single prompt to ChatGPT and returns its answer (no conversation history). | Ask ChatGPT to explain quantum computing in simple terms. |
perplexity |
Sends a single prompt to Perplexity and returns its answer (no conversation history). | Ask Perplexity what the latest trends in web development are. |
Parameters
The following parameters are inferred from user prompts:
| Parameter | Description |
|---|---|
jsRender |
Renders target URL in a headless browser. |
geo |
Sets the country from which the request will originate. |
locale |
Sets the locale of the request. |
tokenLimit |
Maximum number of characters to return (default 45000). Useful if the context window is small. |
prompt |
Prompt to send to AI tools (chatgpt, perplexity). |
search |
Activates ChatGPT's web search functionality (chatgpt only). |
xhr |
When true, includes XHR or fetch responses in the scrape result where supported (e.g. tiktok_post). |
deviceType |
Device type to emulate (desktop, mobile, tablet). Parsed targets are stricter: Amazon tools are desktop-only so they omit it, and bing_search/google_ai_mode accept desktop and mobile only. |
domain |
Domain to use for the request (e.g., amazon.com, amazon.co.uk, bing.com). |
pageFrom |
Starting page number for pagination. |
deliveryZip |
ZIP code for delivery location (Target, Walmart). |
storeId |
Store ID for local inventory (Walmart). |
country |
Country for TikTok Shop requests. |
limit |
Maximum number of results to return (e.g., YouTube channel videos). |
language_code |
Language code for subtitles (e.g., en, es). |
Examples
Scraping geo-restricted content
Query your AI agent with the following prompt:
Scrape peacock.com from a German IP address and tell me the pricing.
This prompt will say that peacock.com is geo-restricted. To bypass the geo-restriction:
Scrape peacock.com from a US IP address and tell me the pricing.
Limiting number of response tokens
If your agent has a small context window, the content returned from scraping will be automatically truncated, in order to avoid context-overflow. You can increase the number of tokens returned within your prompt:
Scrape hacker news, return 50k tokens.
If your agent has a big context window, tell it to return full content:
Scrape hacker news, return full content.
Decodo MCP 질문
Decodo MCP를 Claude Code에 추가하려면 어떻게 하나요?
터미널에서 claude mcp add mcp-server -- npx -y @decodo/mcp-server를 실행합니다. 모든 프로젝트에서 사용할 수 있게 하려면 --scope user를 추가합니다.
Decodo MCP를 Cursor에 추가하려면 어떻게 하나요?
~/.cursor/mcp.json를 열고 mcpServers 아래에 서버를 추가합니다. 위 설치 섹션에 표시된 Cursor 구성을 사용합니다.
Decodo MCP는 어떤 도구를 제공하나요?
33개 도구를 제공합니다. 예: scrape_as_markdown, screenshot, map, crawl_start, crawl_status.
Decodo MCP server는 어떻게 인증하나요?
Authorization 헤더에 Bearer token으로 전송되는 API key를 통해 연결합니다. 이전 요금제에서는 Basic authentication token을 사용할 수도 있습니다.
Decodo MCP는 어떤 출력 형식을 반환하나요?
사용하는 도구에 따라 JSON, Markdown 또는 스크린샷 형태의 구조화된 데이터를 반환합니다.
Decodo MCP 도구 중 일부만 활성화할 수 있나요?
네, 도구는 toolsets(web, search, ecommerce, social_media, ai)로 그룹화되어 있으며, toolsets 쿼리 파라미터를 통해 쉼표로 구분된 목록을 전달하여 선택할 수 있습니다.
Decodo MCP는 JavaScript가 많거나 보호된 사이트도 처리할 수 있나요?
네, 서버 측 JavaScript 렌더링과 안티 봇 기능을 제공하여 차단된 페이지나 동적 페이지도 스크래핑할 수 있습니다.
Decodo API key는 어떻게 발급받나요?
Decodo 대시보드에서 무료 계정을 생성한 후, 구독 페이지에서 Web Data API key를 복사하세요.