TheCrawler
Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
Servidor MCP · de manchittlab
Resumo
TheCrawler é um servidor MCP publicado por manchittlab. Marketplaces que lemos e que o listam: 1 (Official MCP Registry). Vimos pela primeira vez em 2026-10-11 e não registramos mudanças desde então. Conforme nossa passagem pelos marketplaces em 2026-10-13.
O que pede
- Roda na sua máquina
Nenhum dos marketplaces que lemos publica as ferramentas ou as configurações que ele pede.
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Funciona com
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
Um link de um clique abre o cliente, que pede confirmação antes de adicionar o servidor.
Pelos marketplaces que o listam e pelo transporte MCP que declara, conforme cada cliente documenta. Não testamos plugins.
Conectar
Comandos e configurações gerados apenas a partir do que os marketplaces declaram. Não os executamos por você e não testamos plugins.
Como servidor MCP local: pacote npm
Gerado a partir do que Official MCP Registry declara.
claude mcp add --transport stdio thecrawler -- npx -y thecrawler[mcp_servers.thecrawler]
command = "npx"
args = ["-y", "thecrawler"]{
"mcpServers": {
"thecrawler": {
"command": "npx",
"args": [
"-y",
"thecrawler"
]
}
}
}Onde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Official MCP Registry (Abrir o registro) | Listado | 0.5.8 | Forks (GitHub): 0 Estrelas (GitHub): 2 |
Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
O que mudou
Nada mudou neste plugin desde que começamos a acompanhá-lo.
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
oassis — web scraping, crawling and browser control for AI agents
Scrape to markdown, map and crawl sites, drive a real browser. Pay per call, no API key, no signup.
-
Cloud scraping & crawling API for AI agents. Turn any URL into clean, LLM-ready markdown.
-
AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
-
Scrape any URL into clean LLM-ready Markdown, or crawl a whole site.
-
agentfetch io.github.bch1212/agentfetch
Token-budgeted web fetch for AI agents — auto-routes Jina, FireCrawl, Trafilatura, PDF.
-
Search, scrape, and crawl the web for AI agents. Batch scraping and answers with citations.
-
web-scraping com.superagnt/web-scraping
Web scraping for AI agents: scrape, search, crawl, map any website to markdown + JSON. No browser.
-
Web scraping for agents: scrape, crawl, map, search and extract pages as clean markdown or JSON.
-
scrapi io.github.bamchi/scrapi
Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
-
Open-source web scraper for AI agents with scrape, crawl, and map tools
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
Search, scrape, and crawl the web for AI agents. Batch scraping and answers with citations.
-
Web scraping and crawling powered by Firecrawl. Turn any website into clean, LLM-ready markdown or structured data. Scrape single pages, crawl entire sites, search the web, and…
-
The complete web toolkit for your agent. Search the web and get answers in milliseconds. Fetch any URL and get clean markdown content back. Send a browser agent to navigate sites…
-
Crawl any website via Cloudflare Browser Rendering API. Free Firecrawl alternative — returns clean markdown, HTML, or JSON. No rate limits, no API keys to buy.
-
Structured web data extraction for AI agents. Pass any URL and a plain-English prompt describing what data you want — get back clean, structured JSON. Handles JavaScript…
Listado em Claude Code: claude-plugins-official (5)
-
Web scraping and crawling powered by Firecrawl. Turn any website into clean, LLM-ready markdown or structured data. Scrape single pages, crawl entire sites, search the web, and…
-
Web scraping skills for Claude Code powered by the Zyte API — scrape sites, generate and run Scrapy spiders, define extraction schemas, and ship to Scrapy Cloud.
-
Build AI applications with real-time web data using Tavily's search, extract, crawl, and research APIs.
-
Exa AI web search, deep research, and content extraction. Provides MCP tools and research skills for comprehensive web search, people discovery, company research, academic papers…
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
Listado em Claude: knowledge-work-plugins (5)
-
The complete web toolkit for your agent. Search the web and get answers in milliseconds. Fetch any URL and get clean markdown content back. Send a browser agent to navigate sites…
-
Build AI applications with real-time web data using Tavily's search, extract, crawl, and research APIs.
-
Exa AI web search, deep research, and content extraction. Provides MCP tools and research skills for comprehensive web search, people discovery, company research, academic papers…
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
-
Give Claude a real browser — your Chrome or a Browser Use Cloud browser. Use it whenever a task involves a website or web app: browsing, scraping and data extraction, filling…
Listado em Codex: openai-curated (openai/plugins) (5)
-
The Dropbox plugin for ChatGPT connects your Dropbox files directly to ChatGPT. You can access files, save ChatGPT-generated content to Dropbox, and create sharing links without…
-
Use Google Drive as the single entrypoint for Drive, Docs, Sheets, and Slides work.
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Install, open, and connect the signed ChatCut Desktop app from Codex.
-
Work with SharePoint using the configured Microsoft SharePoint app connector.
Listado em Community GitHub marketplaces (5)
-
Web scraping and crawling powered by Firecrawl. Turn any website into clean, LLM-ready markdown or structured data. Scrape single pages, crawl entire sites, search the web, and…
-
Exa AI web search, deep research, and content extraction. Provides MCP tools and research skills for comprehensive web search, people discovery, company research, academic papers…
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
-
One MCP, many parsers. Routes between markitdown, Docling, and LlamaParse. Plus an interpret tool…
-
Browser automation and web page analysis skills using playwright-cli: connect via CDP, probe bot protection, dismiss overlays, capture DOM trees, reduce pages to skeletons…
Listado em Copilot CLI: github/awesome-copilot (5)
-
Helps devs extract data from any website with thousands of trusted scrapers, crawlers, and automations from Apify Store. Integrate ready-made Actors to access all popular social…
-
Three-layer verification pipeline for AI output. Extracts claims, finds sources, and flags hallucination risks so humans can verify before acting.
-
Record your screen doing a manual process, drop the video on your Desktop, and let Copilot CLI analyze it frame-by-frame to build working automation scripts. Supports narrated…
-
Opens a real Chromium window you can navigate and interact with from a Copilot canvas control panel and agent actions.
-
Task Researcher and Task Planner for intermediate to expert users and large codebases - Brought to you by microsoft/edge-ai
Listado em Copilot CLI: github/copilot-plugins (5)
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
-
workiq-productivity
WorkIQ productivity skills powered by the local WorkIQ CLI — read-only insights across email, meetings, calendar, Teams, SharePoint, projects, and people.
-
Advanced Security plugin for GitHub Copilot.
Listado em Cursor: cursor/plugins (5)
-
Browse and automate the web with TinyFish: run multi-step web automations, search the web, extract clean page content, and drive remote stealth browser sessions.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Generate presentations, documents, and webpages.
-
Read, write, and append spreadsheet data.
-
Enrich people and companies, run AI research agents.
Listado em Docker MCP Catalog (5)
-
A Model Context Protocol server for Scrapezy that enables AI models to extract structured data from websites.
-
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
-
scrapegraph-mcp io.github.ScrapeGraphAI/scrapegraph-mcp
AI-powered web scraping and data extraction capabilities through ScrapeGraph API
-
Apify is the world's largest marketplace of tools for web scraping, data extraction, and web automation. You can extract structured data from social media, e-commerce, search…
-
Exa AI web search, deep research, and content extraction. Provides MCP tools and research skills for comprehensive web search, people discovery, company research, academic papers…
Listado em Official MCP Registry (5)
-
oassis — web scraping, crawling and browser control for AI agents
Scrape to markdown, map and crawl sites, drive a real browser. Pay per call, no API key, no signup.
-
Cloud scraping & crawling API for AI agents. Turn any URL into clean, LLM-ready markdown.
-
AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
-
Scrape any URL into clean LLM-ready Markdown, or crawl a whole site.
-
agentfetch io.github.bch1212/agentfetch
Token-budgeted web fetch for AI agents — auto-routes Jina, FireCrawl, Trafilatura, PDF.
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Este plugin é seu?
Adicione-o aos seus projetos e prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS. Você recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Official MCP Registry. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.