io.github.Grubbomatic/crawl-readiness
Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.
Servidor MCP · de Grubbomatic
Resumo
io.github.Grubbomatic/crawl-readiness é um servidor MCP publicado por Grubbomatic. Marketplaces que lemos e que o listam: 1 (Official MCP Registry). A última mudança que registramos foi em 2026-10-12. Conforme nossa passagem pelos marketplaces em 2026-10-13.
O que pede
- Roda na sua máquina
- Segredos: 1
- Configurações: 2
Exige: CRAWL_READINESS_API_KEY (secreta)
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Pacote
npm crawl-readiness-mcp (crawl-readiness-mcp no npm)
- Downloads do npm por semana: 64 (2026-10-12)
- Downloads do npm por mês: 1 464 (2026-10-12)
- Última versão no npm: 0.2.5, publicada em 2026-10-12
- A versão declarada 0.2.5 não consta no npm
Os dados do npm vêm do registro público do npm (registry.npmjs.org, api.npmjs.org). Cada número é do próprio registro e nunca é somado a outro. Um registro que não publica um número não mostra nenhum: sem número não é zero.
Funciona com
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
Pelos marketplaces que o listam e pelo transporte MCP que declara, conforme cada cliente documenta. Não testamos plugins.
Conectar
Comandos e configurações gerados apenas a partir do que os marketplaces declaram. Não os executamos por você e não testamos plugins.
Como servidor MCP local: pacote npm
Gerado a partir do que Official MCP Registry declara.
claude mcp add --env "CRAWL_READINESS_API_KEY=<YOUR_CRAWL_READINESS_API_KEY>" --transport stdio crawl-readiness -- npx -y crawl-readiness-mcp[mcp_servers.crawl-readiness]
command = "npx"
args = ["-y", "crawl-readiness-mcp"]
[mcp_servers.crawl-readiness.env]
CRAWL_READINESS_API_KEY = "<YOUR_CRAWL_READINESS_API_KEY>"{
"mcpServers": {
"crawl-readiness": {
"command": "npx",
"args": [
"-y",
"crawl-readiness-mcp"
],
"env": {
"CRAWL_READINESS_API_KEY": "<YOUR_CRAWL_READINESS_API_KEY>"
}
}
}
}Substitua os valores entre sinais de menor e maior pelos seus. Mostramos os nomes das configurações, nunca valores.
Configurações opcionais que também indica: CRAWL_READINESS_API_BASE.
Onde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Official MCP Registry (Abrir o registro) | Listado | 0.2.5 | Downloads por mês (npm): 1 464 Downloads por semana (npm): 64 Forks (GitHub): 0 Estrelas (GitHub): 0 |
Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
O que mudou
- Official MCP Registry: lançou a versão 0.2.5 (antes 0.2.4)
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
ai-crawler-readiness com.lumnika/ai-crawler-readiness
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
-
Audit webpage access for AI crawlers. API key and Premium or Partner plan required.
-
alice io.tranx/alice
Audit any site's AI visibility from your assistant: crawler access, rendering, and schema.
-
ai-visibility com.lastminutedealshq/ai-visibility
AI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.
-
Check which AI crawlers a site allows and see pages the way AI crawlers do. Free, read-only.
-
ActableSite AI Crawler Monitor
Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.
-
AI Visibility Audit — Can AI crawlers read and cite your site?
One-call audit: robots.txt AI-bot rules, llms.txt, JSON-LD, meta tags, sitemap. Score plus fixes.
-
mcp-agent-accessibility-auditor com.mambabuilt/mcp-agent-accessibility-auditor
Audit whether an AI agent can read a site: llms.txt, robots AI rules, structured data.
-
Asks 8 AI crawlers for your page, checks who really answered, and writes the fixes. MIT.
-
seegeo com.see-geo/seegeo
Audit any website for AI visibility: graded report, findings with fixes, AI crawler access check.
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
Audits public-facing websites across accessibility, SEO, GEO (AI search readiness), and usability -- evaluates 17 checks, assigns a letter grade, and generates a client-ready PDF…
-
Free AI visibility audit for any website. Discover how ChatGPT, Claude, and Perplexity perceive your brand across 5 dimensions and 30 checks — then get a one-click fix plan…
-
Magpie website intelligence over a hosted MCP server. Free: a single-page audit covering overall score, Core Web Vitals, on-page SEO, security headers, robots/sitemap, and…
-
Free SEO, AEO, and GEO toolkit by Akii. Audit websites, plan content strategy, optimize pages, generate schema markup, cluster keywords, and track AI visibility across ChatGPT…
-
Client-side web security scanner — detects secrets, vulnerable JS libraries, misconfigurations, XSS sinks, CORS issues, and more
Listado em Claude Code: claude-plugins-official (5)
-
Web scraping skills for Claude Code powered by the Zyte API — scrape sites, generate and run Scrapy spiders, define extraction schemas, and ship to Scrapy Cloud.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
-
Give Claude a real browser — your Chrome or a Browser Use Cloud browser. Use it whenever a task involves a website or web app: browsing, scraping and data extraction, filling…
-
Web scraping and crawling powered by Firecrawl. Turn any website into clean, LLM-ready markdown or structured data. Scrape single pages, crawl entire sites, search the web, and…
Listado em Claude: knowledge-work-plugins (5)
-
Free AI-powered SEO toolkit — audit websites, plan content strategy, optimize pages, generate schema markup, cluster keywords, and track AI visibility. Works with any website or…
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
-
Give Claude a real browser — your Chrome or a Browser Use Cloud browser. Use it whenever a task involves a website or web app: browsing, scraping and data extraction, filling…
-
The complete web toolkit for your agent. Search the web and get answers in milliseconds. Fetch any URL and get clean markdown content back. Send a browser agent to navigate sites…
-
Configure, run, and interpret HawkScan DAST results inside Claude Code. Generates stackhawk.yml configs, runs scans via CLI or Docker, and transforms security findings into…
Listado em Codex: openai-curated (openai/plugins) (5)
-
Cloudflare platform plugin with curated skills for Workers, Wrangler, and Agents SDK plus the official Cloudflare API MCP server.
-
Codex Security workflows for security scans, analysis, and investigation.
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Available for US1 customers only. Analyze, investigate, and act on your Datadog telemetry directly from ChatGPT using natural language. Ask questions about your production…
-
CrowdStrike Falcon Foundry development skills for building cybersecurity applications on the Falcon platform. Includes UI development, collections, functions, workflows, API…
Listado em Community GitHub marketplaces (5)
-
Browser automation and web page analysis skills using playwright-cli: connect via CDP, probe bot protection, dismiss overlays, capture DOM trees, reduce pages to skeletons…
-
Google Search Console: SEO audits, performance queries, URL inspection, indexing checks.
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
-
Give Claude a real browser — your Chrome or a Browser Use Cloud browser. Use it whenever a task involves a website or web app: browsing, scraping and data extraction, filling…
-
QA-test a website or app and return a 1-5 quality score with evidence. Drives a Browser Use cloud browser and tunnels localhost automatically. Run as /qa <url-or-localhost-port>…
Listado em Copilot CLI: github/awesome-copilot (5)
-
Helps devs extract data from any website with thousands of trusted scrapers, crawlers, and automations from Apify Store. Integrate ready-made Actors to access all popular social…
-
Three-layer verification pipeline for AI output. Extracts claims, finds sources, and flags hallucination risks so humans can verify before acting.
-
Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.
-
MCP server for Chrome DevTools
-
Inspect a repository, improve Tiny Tool Town readiness, submit its listing issue, and launch remediation work.
Listado em Copilot CLI: github/copilot-plugins (5)
-
Advanced Security plugin for GitHub Copilot.
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
-
Bring Azure DevOps work-item, repository, and pull-request workflows into GitHub Copilot.
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
Listado em Cursor: cursor/plugins (5)
-
Browse and automate the web with TinyFish: run multi-step web automations, search the web, extract clean page content, and drive remote stealth browser sessions.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Analyze website traffic, audiences, and competitors.
-
Research keywords, backlinks, rankings, and site health.
-
Track AI visibility, sentiment, and citations.
Listado em Docker MCP Catalog (5)
-
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
-
Apify is the world's largest marketplace of tools for web scraping, data extraction, and web automation. You can extract structured data from social media, e-commerce, search…
-
mcp-server-browserbase io.github.browserbase/mcp-server-browserbase
MCP server for AI web browser automation using Browserbase and Stagehand
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
scrapegraph-mcp io.github.ScrapeGraphAI/scrapegraph-mcp
AI-powered web scraping and data extraction capabilities through ScrapeGraph API
Listado em Official MCP Registry (5)
-
ai-crawler-readiness com.lumnika/ai-crawler-readiness
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
-
Audit webpage access for AI crawlers. API key and Premium or Partner plan required.
-
alice io.tranx/alice
Audit any site's AI visibility from your assistant: crawler access, rendering, and schema.
-
ai-visibility com.lastminutedealshq/ai-visibility
AI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.
-
Check which AI crawlers a site allows and see pages the way AI crawlers do. Free, read-only.
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Este plugin é seu?
Adicione-o aos seus projetos e prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS. Você recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Official MCP Registry. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.