Crawlerpeek
Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.
Servidor MCP · de crawlerpeek
Resumo
Crawlerpeek é um servidor MCP publicado por crawlerpeek. Marketplaces que lemos e que o listam: 1 (Official MCP Registry). A última mudança que registramos foi em 2026-10-29. Conforme nossa passagem pelos marketplaces em 2026-11-10.
O que pede
- Roda na sua máquina
Nenhum dos marketplaces que lemos publica as ferramentas ou as configurações que ele pede.
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Pacote
npm crawlerpeek (crawlerpeek no npm)
- Downloads do npm por semana: 181 (2026-11-08)
- Downloads do npm por mês: 1 698 (2026-11-08)
- Última versão no npm: 0.3.1, publicada em 2026-10-29
Os dados do npm vêm do registro público do npm (registry.npmjs.org, api.npmjs.org). Cada número é do próprio registro e nunca é somado a outro. Um registro que não publica um número não mostra nenhum: sem número não é zero.
Funciona com
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
Um link de um clique abre o cliente, que pede confirmação antes de adicionar o servidor.
Pelos marketplaces que o listam e pelo transporte MCP que declara, conforme cada cliente documenta. Não testamos plugins.
Conectar
Comandos e configurações gerados apenas a partir do que os marketplaces declaram. Não os executamos por você e não testamos plugins.
Como servidor MCP local: pacote npm
Gerado a partir do que Official MCP Registry declara.
claude mcp add --transport stdio crawlerpeek -- npx -y crawlerpeek mcp[mcp_servers.crawlerpeek]
command = "npx"
args = ["-y", "crawlerpeek", "mcp"]{
"mcpServers": {
"crawlerpeek": {
"command": "npx",
"args": [
"-y",
"crawlerpeek",
"mcp"
]
}
}
}Onde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Official MCP Registry (Abrir o registro) | Listado | 0.3.1 | Downloads por mês (npm): 1 698 Downloads por semana (npm): 181 Forks (GitHub): 0 Estrelas (GitHub): 3 |
Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
Como os números mudaram
- 2026-10-273
- 2026-11-103
Cada ponto é um dia em que lemos um número diferente; os trechos planos são dias em que o número não mudou. Números de marketplaces diferentes nunca são somados.
O que mudou
- Official MCP Registry: lançou a versão 0.3.1 (antes 0.2.0)
- Official MCP Registry: lançou a versão 0.2.0 (antes 0.1.2)
- Passou a ser um produto que acompanhamos
- Official MCP Registry: apareceu
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
Shows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.
-
Can GPTBot, ClaudeBot and PerplexityBot reach a site? Real fetch per crawler, firewall/CDN blocks.
-
Which AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why.
-
Audit webpage access for AI crawlers. API key and Premium or Partner plan required.
-
ai-crawler-readiness com.lumnika/ai-crawler-readiness
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
-
Checks a site for AI crawler access, robots.txt and llms.txt. Runs locally, no telemetry.
-
Unrendered: AI Crawler Checker
AI crawler checker: shows which page content GPTBot and ClaudeBot can't read without JavaScript.
-
Check which AI crawlers a site allows and see pages the way AI crawlers do. Free, read-only.
-
crawl-readiness io.github.Grubbomatic/crawl-readiness
Check what AI crawlers may read and what a page permits, generate llms.txt and schema.
-
ActableSite AI Crawler Monitor
Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
A Claude Code skill that lets Claude drive the browser-act CLI from natural-language prompts — navigating, interacting with, extracting from, and screenshotting webpages…
-
Skyvern browser automation skills for web scraping and interaction via remote MCP.
-
Data freshness and endpoint liveness verification for AI agents. Probes external APIs and endpoints before agents act on their data, returning deterministic FRESH/STALE/UNKNOWN…
-
AI-powered browser testing against any URL using personality-driven agents -- speedrunners, chaos gremlins, skeptical executives -- each surfacing different categories of…
-
The complete web toolkit for your agent. Search the web and get answers in milliseconds. Fetch any URL and get clean markdown content back. Send a browser agent to navigate sites…
Listado em Claude Code: claude-plugins-official (5)
-
Give Claude a real browser — your Chrome or a Browser Use Cloud browser. Use it whenever a task involves a website or web app: browsing, scraping and data extraction, filling…
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Web scraping skills for Claude Code powered by the Zyte API — scrape sites, generate and run Scrapy spiders, define extraction schemas, and ship to Scrapy Cloud.
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
-
Exa AI web search, deep research, and content extraction. Provides MCP tools and research skills for comprehensive web search, people discovery, company research, academic papers…
Listado em Claude: knowledge-work-plugins (5)
-
Give Claude a real browser — your Chrome or a Browser Use Cloud browser. Use it whenever a task involves a website or web app: browsing, scraping and data extraction, filling…
-
The complete web toolkit for your agent. Search the web and get answers in milliseconds. Fetch any URL and get clean markdown content back. Send a browser agent to navigate sites…
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
-
Exa AI web search, deep research, and content extraction. Provides MCP tools and research skills for comprehensive web search, people discovery, company research, academic papers…
-
Free AI-powered SEO toolkit — audit websites, plan content strategy, optimize pages, generate schema markup, cluster keywords, and track AI visibility. Works with any website or…
Listado em Codex: openai-curated (openai/plugins) (5)
-
Cloudflare platform plugin with curated skills for Workers, Wrangler, and Agents SDK plus the official Cloudflare API MCP server.
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Codex Security workflows for security scans, analysis, and investigation.
-
Available for US1 customers only. Analyze, investigate, and act on your Datadog telemetry directly from ChatGPT using natural language. Ask questions about your production…
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
Listado em Community GitHub marketplaces (3)
-
Free AI search audits with no account: which AI crawlers your robots.txt lets in, and whether your llms.txt is present and well formed.
-
Browser automation and web page analysis skills using playwright-cli: connect via CDP, probe bot protection, dismiss overlays, capture DOM trees, reduce pages to skeletons…
-
Stealth browser automation skill using Pydoll, specialized in bypassing Cloudflare WAF, Turnstile CAPTCHA, and other bot detection systems.
Listado em Copilot CLI: github/awesome-copilot (5)
-
Helps devs extract data from any website with thousands of trusted scrapers, crawlers, and automations from Apify Store. Integrate ready-made Actors to access all popular social…
-
MCP server for Chrome DevTools
-
Three-layer verification pipeline for AI output. Extracts claims, finds sources, and flags hallucination risks so humans can verify before acting.
-
Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.
-
See a live map of the Copilot agents on your computer, their sub-agents, their commands, and where their data goes.
Listado em Copilot CLI: github/copilot-plugins (5)
-
Advanced Security plugin for GitHub Copilot.
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
Bring Azure DevOps work-item, repository, and pull-request workflows into GitHub Copilot.
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
Listado em Cursor: cursor/plugins (5)
-
Browse and automate the web with TinyFish: run multi-step web automations, search the web, extract clean page content, and drive remote stealth browser sessions.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Analyze website traffic, audiences, and competitors.
-
Let Grok Bot reach MCP servers on your private Tailscale network: connect your own tailnet, or your team's company tailnets turned on by a team admin, with each member using their…
-
CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.
Listado em Docker MCP Catalog (5)
-
mcp-server-browserbase io.github.browserbase/mcp-server-browserbase
MCP server for AI web browser automation using Browserbase and Stagehand
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Apify is the world's largest marketplace of tools for web scraping, data extraction, and web automation. You can extract structured data from social media, e-commerce, search…
-
Firecrawl, the context API for AI agents: search, scrape, interact with the web, plus paper search.
-
oxylabs-mcp io.oxylabs/oxylabs-mcp
Fetch and process content from specified URLs & sources using the Oxylabs Web Scraper API.
Listado em Official MCP Registry (5)
-
Shows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.
-
Can GPTBot, ClaudeBot and PerplexityBot reach a site? Real fetch per crawler, firewall/CDN blocks.
-
Which AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why.
-
Audit webpage access for AI crawlers. API key and Premium or Partner plan required.
-
ai-crawler-readiness com.lumnika/ai-crawler-readiness
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
Listado em PyPI (MCP servers) (5)
-
Screaming Frog SEO Spider MCP Server (headless)
Headless Screaming Frog SEO Spider via its CLI: run crawls, export and filter data, no GUI needed.
-
Undetectable browser automation for AI agents via the Model Context Protocol — one shared backend built for 50+ concurrent Claude Code sessions.
-
firecrawl com.mcparmory/firecrawl
Scrape, crawl, and extract structured data from websites at scale
-
Read Bing Webmaster data and change it, directly or through a reviewed plan.
-
MCP server with 173 tools: a real Chrome browser over CDP with nodriver, HTTP with Chrome's TLS fingerprint, Cloudflare Turnstile handling, session reuse, and web research without…
Listado em npm registry (MCP servers) (5)
-
crawl-readiness io.github.Grubbomatic/crawl-readiness
Check what AI crawlers may read and what a page permits, generate llms.txt and schema.
-
Analyse robots.txt content and report whether a path may be crawled.
-
AI visibility in ChatGPT, Gemini, Claude, Perplexity, Copilot & AI Overviews, plus site audits.
-
Anti-detection browser MCP server for AI agents — navigate, interact, and automate the web without getting blocked
-
zenrows-mcp io.github.ZenRows/zenrows-mcp
Zenrows MCP server: Fetch, Extract, Batch, and Browser Sessions for AI agents
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Quer esta marca no seu plugin em nosso catálogo?
Prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS, e você poderá mostrar esta marca na ficha, com banners ao vivo para o seu site e o README. Como funciona a verificação
Você também recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Official MCP Registry. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.