Website Crawler — Markdown Pages, Sitemaps & RAG Provenance
Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay
Servidor MCP · de kriton-dev
Resumo
Website Crawler — Markdown Pages, Sitemaps & RAG Provenance é um servidor MCP publicado por kriton-dev. Marketplaces que lemos e que o listam: 1 (Official MCP Registry). A última mudança que registramos foi em 2026-11-02. Conforme nossa passagem pelos marketplaces em 2026-11-06.
O que pede
- Roda remotamente
Nenhum dos marketplaces que lemos publica as ferramentas ou as configurações que ele pede.
Exige: cabeçalho Authorization
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Conectar
Sem dados para um comando automático: o que os marketplaces declaram não diz de forma inequívoca como conectá-lo.
Onde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Official MCP Registry (Abrir o registro) | Listado | 1.0.4 | Nenhum número publicado | Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
O que mudou
- Official MCP Registry: título mudou para Website Crawler — Markdown Pages, Sitemaps & RAG Provenance
- Official MCP Registry: lançou a versão 1.0.4 (antes 1.0.2)
- Passou a ser um produto que acompanhamos
- Official MCP Registry: apareceu
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.
-
Web search, URL content extraction to Markdown, site mapping, and recursive web crawler.
-
Web crawling and scraping with HTML→Markdown and headless-Chrome fallback.
-
@just-every/mcp-read-website-fast
Markdown Content Preprocessor - Fetch web pages, extract content, convert to clean Markdown
-
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
-
Crawl and scrape websites to clean markdown, and track what changed between crawls.
-
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
-
Convert a web page URL to clean Markdown for LLM context. Local, no external API calls.
-
Read one public web page as clean Markdown with its links, after a robots.txt check.
-
Read any public web page as clean Markdown for LLMs. Respects robots.txt. Free tier; x402 paid API.
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
Live web search, scraping and crawling API for AI. Get structured, LLM-ready data from any site.
-
Crawl any website via Cloudflare Browser Rendering API. Free Firecrawl alternative — returns clean markdown, HTML, or JSON. No rate limits, no API keys to buy.
-
Universal web content extraction — convert any URL to clean, LLM-ready markdown. Supports HTML pages (with content density filtering and auto-fallback to Playwright for JS-heavy…
-
Fetch web pages and convert HTML to clean, LLM-optimized Markdown. Extracts article content, strips boilerplate, estimates token count. No browser needed.
-
Web scraping and crawling powered by Firecrawl. Turn any website into clean, LLM-ready markdown or structured data. Scrape single pages, crawl entire sites, search the web, and…
Listado em Claude Code: claude-plugins-official (5)
-
Web scraping and crawling powered by Firecrawl. Turn any website into clean, LLM-ready markdown or structured data. Scrape single pages, crawl entire sites, search the web, and…
-
Build beautiful documentation sites with Mintlify. Convert non-markdown files into properly formatted MDX pages, add and modify content with correct component use, and automate…
-
Web scraping skills for Claude Code powered by the Zyte API — scrape sites, generate and run Scrapy spiders, define extraction schemas, and ship to Scrapy Cloud.
-
Tools to maintain and improve CLAUDE.md files - audit quality, capture session learnings, and keep project memory current.
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
Listado em Claude: knowledge-work-plugins (5)
-
The complete web toolkit for your agent. Search the web and get answers in milliseconds. Fetch any URL and get clean markdown content back. Send a browser agent to navigate sites…
-
Build beautiful documentation sites with Mintlify. Convert non-markdown files into properly formatted MDX pages, add and modify content with correct component use, and automate…
-
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot…
-
Exa AI web search, deep research, and content extraction. Provides MCP tools and research skills for comprehensive web search, people discovery, company research, academic papers…
-
Give Claude a real browser — your Chrome or a Browser Use Cloud browser. Use it whenever a task involves a website or web app: browsing, scraping and data extraction, filling…
Listado em Codex: openai-curated (openai/plugins) (5)
-
The Dropbox plugin for ChatGPT connects your Dropbox files directly to ChatGPT. You can access files, save ChatGPT-generated content to Dropbox, and create sharing links without…
-
Work with SharePoint using the configured Microsoft SharePoint app connector.
-
Inspect repositories, triage pull requests and issues, debug CI, and publish changes through a hybrid GitHub connector and CLI workflow.
-
Use Google Drive as the single entrypoint for Drive, Docs, Sheets, and Slides work.
-
Install, open, and connect the signed ChatCut Desktop app from Codex.
Listado em Community GitHub marketplaces (5)
-
Web crawling and scraping with HTML→Markdown and headless-Chrome fallback.
-
felo-web-fetch
Fetch and extract webpage content in markdown, text, or HTML format
-
Install, troubleshoot, and use Scrapling CLI for extracting HTML, Markdown, or text from webpages. Diagnoses missing extras, Playwright browser runtime issues, TLS verification…
-
Convert documents and files to Markdown using markitdown. Use when converting PDF, Word (.docx), PowerPoint (.pptx), Excel (.xlsx, .xls), HTML, CSV, JSON, XML, images (with…
-
Any file → clean Markdown for AI agents: PDF, Office, EPUB, HTML, images, audio/video. Local MCP.
Listado em Copilot CLI: github/awesome-copilot (5)
-
Helps devs extract data from any website with thousands of trusted scrapers, crawlers, and automations from Apify Store. Integrate ready-made Actors to access all popular social…
-
Compose and refine launch-ready release notes with contributor callouts and export-friendly output.
-
Generate professional project documentation with draw.io architecture diagrams and Word (.docx) output with embedded images. Automatically discovers any project's technology stack…
-
A collection of Copilot skills that convert common document formats into Markdown so their contents can be accurately analyzed, summarized, searched, or extracted from. Just tell…
-
Record your screen doing a manual process, drop the video on your Desktop, and let Copilot CLI analyze it frame-by-frame to build working automation scripts. Supports narrated…
Listado em Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
mcp-apps
Generate MCP App widgets for MCP tools. Produces self-contained HTML widgets using the MCP Apps protocol.
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
-
Bring Azure DevOps work-item, repository, and pull-request workflows into GitHub Copilot.
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
Listado em Cursor: cursor/plugins (5)
-
Browse and automate the web with TinyFish: run multi-step web automations, search the web, extract clean page content, and drive remote stealth browser sessions.
-
Generate presentations, documents, and webpages.
-
Search docs, read pages, and update tables.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Render documentation as a navigable canvas.
Listado em Docker MCP Catalog (5)
-
Fetches a URL from the internet and extracts its contents as markdown.
-
A Model Context Protocol server for converting almost anything to Markdown.
-
A lightweight MCP server for calling MarkItDown.
-
A Model Context Protocol server for Scrapezy that enables AI models to extract structured data from websites.
-
scrapegraph-mcp io.github.ScrapeGraphAI/scrapegraph-mcp
AI-powered web scraping and data extraction capabilities through ScrapeGraph API
Listado em Official MCP Registry (5)
-
Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.
-
Web search, URL content extraction to Markdown, site mapping, and recursive web crawler.
-
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
-
Crawl and scrape websites to clean markdown, and track what changed between crawls.
-
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
Listado em PyPI (MCP servers) (5)
-
firecrawl com.mcparmory/firecrawl
Scrape, crawl, and extract structured data from websites at scale
-
Section-level doc search for .md, .rst, .adoc, .org, .ipynb, .html, .yaml, .json, and OpenAPI specs.
-
promptready-mcp io.github.hydrojwh/promptready-mcp
Convert PDF/CSV to Markdown with AI-powered OCR via the PromptReady cloud API.
-
agentql com.mcparmory/agentql
Query webpages and extract structured data using natural language
-
mcp-webextrator io.github.AceDataCloud/mcp-webextrator
MCP server for web extraction and rendering via AceDataCloud WebExtrator
Listado em npm registry (MCP servers) (5)
-
@just-every/mcp-read-website-fast
Markdown Content Preprocessor - Fetch web pages, extract content, convert to clean Markdown
-
Web scraping, search, crawling, structured extraction and research for AI agents.
-
Pages, crawls and URL batches as clean Markdown and JSON for AI agents, with an Evidence Record.
-
HTTP fetch MCP server: SSRF protection, HTML-to-markdown, reader mode, metadata extraction
-
crawlforge-mcp-server io.github.mysleekdesigns/crawlforge-mcp-server
Web scraping, crawling, deep research & autonomous extraction — 31 MCP tools, clean Markdown/JSON
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Quer esta marca no seu plugin em nosso catálogo?
Prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS, e você poderá mostrar esta marca na ficha, com banners ao vivo para o seu site e o README. Como funciona a verificação
Você também recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Official MCP Registry. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.