Crawl Census
Ask before you fetch: will this domain serve your crawler, refuse it, or charge it?
Servidor MCP · de taylorsmithgg
Resumo
Crawl Census é um servidor MCP publicado por taylorsmithgg. Marketplaces que lemos e que o listam: 1 (Official MCP Registry). Vimos pela primeira vez em 2026-10-11 e não registramos mudanças desde então. Conforme nossa passagem pelos marketplaces em 2026-10-14.
O que pede
- Roda remotamente
Nenhum dos marketplaces que lemos publica as ferramentas ou as configurações que ele pede.
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Funciona com
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
Um link de um clique abre o cliente, que pede confirmação antes de adicionar o servidor.
Pelos marketplaces que o listam e pelo transporte MCP que declara, conforme cada cliente documenta. Não testamos plugins.
Conectar
Comandos e configurações gerados apenas a partir do que os marketplaces declaram. Não os executamos por você e não testamos plugins.
Como servidor MCP remoto
Gerado a partir do que Official MCP Registry declara.
claude mcp add --transport http crawl-census https://crawlcensus.com/mcp[mcp_servers.crawl-census]
url = "https://crawlcensus.com/mcp"{
"mcpServers": {
"crawl-census": {
"url": "https://crawlcensus.com/mcp"
}
}
}Onde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Official MCP Registry (Abrir o registro) | Listado | 1.0.0 | Forks (GitHub): 0 Estrelas (GitHub): 0 |
Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
O que mudou
Nada mudou neste plugin desde que começamos a acompanhá-lo.
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key
-
Crawlbase MCP — wraps the Crawlbase Crawling API (crawlbase.com, formerly
-
Screaming Frog SEO Spider MCP Server (headless)
Headless Screaming Frog SEO Spider via its CLI: run crawls, export and filter data, no GUI needed.
-
Firecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web
-
Can GPTBot, ClaudeBot and PerplexityBot reach a site? Real fetch per crawler, firewall/CDN blocks.
-
Analyse robots.txt content and report whether a path may be crawled.
-
Firecrawl Alternative Stealth MCP
WAF-bypass web scraper and passive URL mapper for AI agents with zero pay-on-fail.
-
Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
-
ai-visibility com.lastminutedealshq/ai-visibility
AI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.
-
Crawl, scrape, search the web, and automate browsers at scale with anti-bot bypass.
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
Search, scrape, and crawl the web for AI agents. Batch scraping and answers with citations.
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
-
Web scraping skills for Claude Code powered by the Zyte API — scrape sites, generate and run Scrapy spiders, define extraction schemas, and ship to Scrapy Cloud.
-
Skyvern browser automation skills for web scraping and interaction via remote MCP.
-
Stop wasting tokens on things free APIs can answer instantly. A cross-platform MCP server that turns public APIs into clean, agent-ready tools.
Listado em Claude Code: claude-plugins-official (5)
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
-
Web scraping skills for Claude Code powered by the Zyte API — scrape sites, generate and run Scrapy spiders, define extraction schemas, and ship to Scrapy Cloud.
-
Give Claude a real browser — your Chrome or a Browser Use Cloud browser. Use it whenever a task involves a website or web app: browsing, scraping and data extraction, filling…
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Exa AI web search, deep research, and content extraction. Provides MCP tools and research skills for comprehensive web search, people discovery, company research, academic papers…
Listado em Claude: knowledge-work-plugins (5)
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
-
Give Claude a real browser — your Chrome or a Browser Use Cloud browser. Use it whenever a task involves a website or web app: browsing, scraping and data extraction, filling…
-
Exa AI web search, deep research, and content extraction. Provides MCP tools and research skills for comprehensive web search, people discovery, company research, academic papers…
-
The complete web toolkit for your agent. Search the web and get answers in milliseconds. Fetch any URL and get clean markdown content back. Send a browser agent to navigate sites…
-
Sanity content platform integration with MCP server, agent skills, and slash commands. Query and author content, build and optimize GROQ queries, design schemas, and set up Visual…
Listado em Codex: openai-curated (openai/plugins) (5)
-
Cloudflare platform plugin with curated skills for Workers, Wrangler, and Agents SDK plus the official Cloudflare API MCP server.
-
Available for US1 customers only. Analyze, investigate, and act on your Datadog telemetry directly from ChatGPT using natural language. Ask questions about your production…
-
Codex Security workflows for security scans, analysis, and investigation.
-
CrowdStrike Falcon Fusion skills for authoring, deploying, and executing Fusion workflows. Includes live action discovery, YAML authoring with schema validation, workflow import…
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
Listado em Community GitHub marketplaces (5)
-
Scrape, crawl, batch-scrape, map, and search the web through the hosted pline.ai API.
-
SEO audits and AI crawler checks. Honest findings only; no invented scores.
-
Scrape, crawl, map, search, parse, extract, and change-track the web with fastCRW, the open-source, self-hostable Firecrawl alternative. Single Rust binary, ~6.6 MB idle RAM…
-
AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.
-
Browser automation and web page analysis skills using playwright-cli: connect via CDP, probe bot protection, dismiss overlays, capture DOM trees, reduce pages to skeletons…
Listado em Copilot CLI: github/awesome-copilot (5)
-
Helps devs extract data from any website with thousands of trusted scrapers, crawlers, and automations from Apify Store. Integrate ready-made Actors to access all popular social…
-
Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.
-
Use Datadog directly in Copilot / VS Code through a preconfigured Datadog MCP server. Query logs, metrics, traces, dashboards, and more through natural conversation.
-
Visualizes live session AI-credit usage as a Pac-Man board with pellets, ghosts, fruit milestones, and game-over limits.
-
Interactive GitHub Copilot canvas for discovering, connecting, and managing hosted MCP servers from an Azure Connector Namespace.
Listado em Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
Advanced Security plugin for GitHub Copilot.
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
-
mcp-apps
Generate MCP App widgets for MCP tools. Produces self-contained HTML widgets using the MCP Apps protocol.
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
Listado em Cursor: cursor/plugins (5)
-
Browse and automate the web with TinyFish: run multi-step web automations, search the web, extract clean page content, and drive remote stealth browser sessions.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Let Grok Bot reach MCP servers on your private Tailscale network. Sign in to Tailscale to connect your tailnet; Grok Bot joins it as one tagged device and only reaches the hosts…
-
Analyze website traffic, audiences, and competitors.
-
Work with PostHog from chat: query product analytics and run SQL, manage feature flags and experiments, triage error tracking issues, and review session replays, surveys, and…
Listado em Docker MCP Catalog (5)
-
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
-
oxylabs-mcp io.oxylabs/oxylabs-mcp
Fetch and process content from specified URLs & sources using the Oxylabs Web Scraper API.
-
A MCP server implementation for hyperbrowser.
-
Apify is the world's largest marketplace of tools for web scraping, data extraction, and web automation. You can extract structured data from social media, e-commerce, search…
-
scrapegraph-mcp io.github.ScrapeGraphAI/scrapegraph-mcp
AI-powered web scraping and data extraction capabilities through ScrapeGraph API
Listado em Official MCP Registry (5)
-
{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key
-
Crawlbase MCP — wraps the Crawlbase Crawling API (crawlbase.com, formerly
-
Screaming Frog SEO Spider MCP Server (headless)
Headless Screaming Frog SEO Spider via its CLI: run crawls, export and filter data, no GUI needed.
-
Firecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web
-
Can GPTBot, ClaudeBot and PerplexityBot reach a site? Real fetch per crawler, firewall/CDN blocks.
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Este plugin é seu?
Adicione-o aos seus projetos e prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS. Você recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Official MCP Registry. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.