Benchwarmers
Ask a collection of LLMs at once through your Benchwarmers server; verdicts pick the next panel.
MCP server · by WendellResearch-AI
About
Benchwarmers is an MCP server published by WendellResearch-AI. Marketplaces we read that list it: 1 (Official MCP Registry). The last change we recorded was on 2026-11-10. As of our marketplace pass on 2026-11-10.
What it asks for
- Runs on your machine
- Secrets: 1
- Settings: 3
Requires: BENCHWARMERS_KEY (secret)
What it declares, asks for and runs, in full
Only install plugins from developers you trust. We list what marketplaces publish and do not test plugins.
Package
npm @wendellresearch-ai/benchwarmers (@wendellresearch-ai/benchwarmers on npm)
- npm downloads/week: 1 420 (2026-11-05)
- npm downloads/month: 3 310 (2026-11-05)
- Latest version on npm: 0.5.5, published 2026-11-02
- Declared version 0.6.5 is not listed on npm
npm facts come from the public npm registry (registry.npmjs.org, api.npmjs.org). Each figure is the registry's own and is never added to another. A registry that publishes no figure shows none: no number is not zero.
Works with
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
From the marketplaces that list it and the MCP transport it declares, as each client documents them. We do not test plugins.
Connect
Commands and configs built only from what its marketplaces declare. We do not run them for you and do not test plugins.
As a local MCP server: npm package
Built from what Official MCP Registry declares.
claude mcp add --env "BENCHWARMERS_KEY=<YOUR_BENCHWARMERS_KEY>" --transport stdio benchwarmers -- npx -y @wendellresearch-ai/benchwarmers mcp[mcp_servers.benchwarmers]
command = "npx"
args = ["-y", "@wendellresearch-ai/benchwarmers", "mcp"]
[mcp_servers.benchwarmers.env]
BENCHWARMERS_KEY = "<YOUR_BENCHWARMERS_KEY>"{
"mcpServers": {
"benchwarmers": {
"command": "npx",
"args": [
"-y",
"@wendellresearch-ai/benchwarmers",
"mcp"
],
"env": {
"BENCHWARMERS_KEY": "<YOUR_BENCHWARMERS_KEY>"
}
}
}
}Replace the values in angle brackets with your own. We show the names of the settings, never values.
Optional settings it also lists: BENCHWARMERS_TIMEOUT, BENCHWARMERS_URL.
Where it is published
| Marketplace | Status | Version | Figures | Verified | First seen |
|---|---|---|---|---|---|
| Official MCP Registry (Open the registry record) | Listed | 0.6.5 | Downloads/month (npm): 3 310 Downloads/week (npm): 1 420 Forks (GitHub): 0 Stars (GitHub): 1 |
Not marked |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
What changed
- Official MCP Registry: released version 0.6.5 (was 0.6.3)
- Official MCP Registry: released version 0.6.3 (was 0.6.2)
- Official MCP Registry: released version 0.6.2 (was 0.6.0)
- Official MCP Registry: released version 0.6.0 (was 0.5.6)
- Official MCP Registry: released version 0.5.6 (was 0.5.5)
- Official MCP Registry: released version 0.5.5 (was 0.5.4)
- Official MCP Registry: released version 0.5.4 (was 0.5.2)
- Official MCP Registry: released version 0.5.2 (was 0.5.1)
- Official MCP Registry: released version 0.5.1 (was 0.5.0)
- Official MCP Registry: released version 0.5.0 (was 0.4.0)
- Official MCP Registry: released version 0.4.0 (was 0.3.3)
- Official MCP Registry: released version 0.3.3 (was 0.3.2)
- Official MCP Registry: released version 0.3.2 (was 0.3.1)
- Official MCP Registry: released version 0.3.1 (was 0.3.0)
- Official MCP Registry: released version 0.3.0 (was 0.2.2)
- Became a product we track
- Official MCP Registry: appeared
Similar plugins
Products whose own names, descriptions, tools and skills are closest in meaning to this one, on every marketplace we read. Closeness is ranked within this list only.
-
Public benchmark where agents submit Q&A answers and get scored on a leaderboard.
-
Talk to thousands of real people, or put two of them in a room and watch them argue.
-
Real-time chat hub for AI agents — Claude Code, Cursor, Cline, Codex over MCP or REST.
-
poordjaevin io.github.Icaro0310/poordjaevin
Typed answers with calibrated confidence for agents. Local-first, no API key.
-
Real human judgment as agent tools — ask a question, get a structured human answer back.
-
AI-powered prompt refinement with adaptive questioning and multi-provider support (6+ LLM backends)
-
Multi-expert decision intelligence with transparent synthesis and auditable workflows.
-
Use OpenMayhem text, embedding and media models with explicit cost controls.
-
LLM benchmark rankings, drift status, incidents and Smart Router previews from AI Stupid Level.
-
Ask free LLMs (DeepSeek, GLM, Gemini, Mistral) for a second opinion from any MCP client.
Similar plugins by marketplace
The same question asked of one marketplace at a time: is there an analog of this plugin there?
Has a listing on Claude Code: claude-plugins-community (5)
-
Coordinate multi-agent debates across different AI platforms (Claude Code, Antigravity, Copilot, Gemini CLI, etc.) using a shared file protocol. Each agent reads one skill and…
-
Multi-model deliberation over MCP: full responses plus typed cross-model reactions from other labs.
-
Search, browse, and install MCP servers, agents, skills, prompts, and plugins from the conduitAI catalog — directly from Claude Code.
-
AI Cowork metabrain with Knowledge Graph, Thought Stack, Fuel Intelligence, and local AI Overseer. 20 native MCP tools for persistent session memory across Claude instances.
-
Multi-LLM orchestration for Claude Code and Cowork. Coordinates 8 AI providers (Codex, Gemini, Claude, Perplexity, OpenRouter, Copilot, Qwen, Ollama) through structured Double…
Has a listing on Claude Code: claude-plugins-official (5)
-
Sanity content platform integration with MCP server, agent skills, and slash commands. Query and author content, build and optimize GROQ queries, design schemas, and set up Visual…
-
Output.ai workflow development toolkit for Claude Code. Adds 5 specialist agents (planner, builder, debugger, prompt writer, quality reviewer), 40+ slash-command skills covering…
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Agent Skills for Together AI platform — inference, training, embeddings, audio, video, images, function calling, and infrastructure. Covers serverless chat completions…
Has a listing on Claude: knowledge-work-plugins (5)
-
Sanity content platform integration with MCP server, agent skills, and slash commands. Query and author content, build and optimize GROQ queries, design schemas, and set up Visual…
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Build multimodal AI applications with Pixeltable -- tables, computed columns, embedding search, UDFs, tool-calling agents, and 25+ AI provider integrations.
-
Connects Claude Code to the Synthflow AI voice-agent platform through its hosted MCP server, with skills for reviewing calls and auditing agent prompts, plus a docs-search…
Has a listing on Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
Install, open, and connect the signed ChatCut Desktop app from Codex.
-
CrowdStrike Falcon Foundry development skills for building cybersecurity applications on the Falcon platform. Includes UI development, collections, functions, workflows, API…
Has a listing on Community GitHub marketplaces (5)
-
Build high-quality MCP servers for LLM integrations
-
Connect Baizhi Agent Toolkit through an authenticated remote MCP server, with an optional skill for bounded research and source verification. Requires a Baizhi account and API…
-
Provider-aware model and effort routing with Anthropic, DeepSeek, z.ai, MiniMax, MiMo and Kimi defaults, custom profiles, classifier advice and native controls.
-
autogen
Build conversational multi-agent systems with Microsoft AutoGen. AssistantAgent, UserProxyAgent, GroupChat, code execution, nested chats, cancellation tokens, tool integration…
-
Marketing media generation — image, video, voice — for AI agents. BYO keys.
Has a listing on Copilot CLI: github/awesome-copilot (5)
-
Multi-model council for Copilot CLI: three subagents on different model families (Anthropic, OpenAI, Google) answer independently, then build on each other or attack the leading…
-
Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
-
Visualizes live session AI-credit usage as a Pac-Man board with pellets, ghosts, fruit milestones, and game-over limits.
-
Microsoft Copilot Studio YAML authoring toolkit. Create, edit, validate, and test Copilot Studio agents using YAML files.
Has a listing on Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
-
mcp-apps
Generate MCP App widgets for MCP tools. Produces self-contained HTML widgets using the MCP Apps protocol.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
Has a listing on Cursor: cursor/plugins (5)
-
Iterative self-referential AI loops using the Ralph Wiggum technique.
-
Consult a stronger model before major decisions, when stuck, and before declaring done.
-
Incremental transcript-driven memory updates for AGENTS.md using high-signal bullet points only.
-
Search company knowledge and draft verified answers.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
Has a listing on Docker MCP Catalog (5)
-
Discover and connect to a curated marketplace of MCP servers for extending AI agent capabilities.
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Wayfound’s MCP server allows business users to govern, supervise, and improve AI Agents.
-
The Official Model Context Protocol (MCP) server for Kagi Search & other tools.
-
Firecrawl, the context API for AI agents: search, scrape, interact with the web, plus paper search.
Has a listing on Official MCP Registry (5)
-
Public benchmark where agents submit Q&A answers and get scored on a leaderboard.
-
Talk to thousands of real people, or put two of them in a room and watch them argue.
-
Real-time chat hub for AI agents — Claude Code, Cursor, Cline, Codex over MCP or REST.
-
poordjaevin io.github.Icaro0310/poordjaevin
Typed answers with calibrated confidence for agents. Local-first, no API key.
-
Real human judgment as agent tools — ask a question, get a structured human answer back.
Has a listing on PyPI (MCP servers) (5)
-
marm-mcp-server io.github.Lyellr88/marm-mcp-server
Universal MCP Server with advanced AI memory capabilities and semantic search.
-
Automatic MCP Server & OpenAI Tools Bridge for apcore
-
AI Agents Framework with Self Reflection and MCP support
-
Model Context Protocol (MCP) To LangChain Tools Conversion Utility
-
Unified MCP server for AgenticLens and Agentic Chaos capabilities.
Has a listing on npm registry (MCP servers) (5)
-
rubber-duck io.github.nesquikm/rubber-duck
Bridge to multiple LLMs and CLI agents: councils, debates, voting, and more
-
Contextual prompts and agent skills for 140+ AI platforms.
-
Automatic MCP Server & OpenAI Tools Bridge for apcore
-
Decision lock, anti-hallucination, meta-evolution and provenance for any MCP agent. 55 tools.
-
OSS to create Personas, Skills, Templates, Agents, and Memories to customize your AI experience.
Found by meaning, not by shared code or a shared repository: similar plugins stay separate products, and this is not a review or a recommendation.
Want this mark on your plugin in our catalog?
Prove you maintain it with a file in its repository, a file on your domain or a DNS record, and you can show this mark on the card, with live banners for your site and README. How verification works
You also get alerts when a marketplace lists it, drops it, changes its verified mark or what it asks for, and its remote endpoint goes on monitoring as a web service.
Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.