io.github.dbsectrainer/mcp-eval-runner
A standardized testing harness for MCP servers and agent workflows
MCP server · by dbsectrainer
About
io.github.dbsectrainer/mcp-eval-runner is an MCP server published by dbsectrainer. Marketplaces we read that list it: 1 (Official MCP Registry). We first saw it on 2026-10-11 and have recorded no change since. As of our marketplace pass on 2026-10-12.
What it asks for
- Runs on your machine
- Secrets: 1
- Settings: 1
What it declares, asks for and runs, in full
Only install plugins from developers you trust. We list what marketplaces publish and do not test plugins.
Connect
Commands and configs built only from what its marketplaces declare. We do not run them for you and do not test plugins.
As a local MCP server: npm package
Built from what Official MCP Registry declares.
claude mcp add --env "YOUR_API_KEY=<YOUR_YOUR_API_KEY>" --transport stdio mcp-eval-runner -- npx -y mcp-eval-runner[mcp_servers.mcp-eval-runner]
command = "npx"
args = ["-y", "mcp-eval-runner"]
[mcp_servers.mcp-eval-runner.env]
YOUR_API_KEY = "<YOUR_YOUR_API_KEY>"{
"mcpServers": {
"mcp-eval-runner": {
"command": "npx",
"args": [
"-y",
"mcp-eval-runner"
],
"env": {
"YOUR_API_KEY": "<YOUR_YOUR_API_KEY>"
}
}
}
}Replace the values in angle brackets with your own. We show the names of the settings, never values.
We do not store launch arguments. If the server needs any, its own documentation names them.
Where it is published
| Marketplace | Status | Version | Figures | Verified | First seen |
|---|---|---|---|---|---|
| Official MCP Registry (Open the registry record) | Listed | 1.0.0 | Forks (GitHub): 0 Stars (GitHub): 0 |
Not marked |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
What changed
Nothing has moved on this plugin since we started watching it.
Similar plugins
Products whose own names, descriptions, tools and skills are closest in meaning to this one, on every marketplace we read. Closeness is ranked within this list only.
-
mcp io.github.sapiom/mcp
Local Sapiom developer MCP for authoring, testing, deploying, and inspecting agents.
-
Local test execution and coverage summaries for onboarding agents.
-
meok-mcp-test-mcp io.github.CSOAI-ORG/meok-mcp-test-mcp
MEOK MCP Test MCP — golden-file + schema-drift + tool-failure tests for any MCP server. Drop-in
-
testkube-mcp io.github.kubeshop/testkube-mcp
MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants
-
mcp-agent-trace-inspector io.github.dbsectrainer/mcp-agent-trace-inspector
Step-by-step observability for MCP agent workflows
-
evals-mcp-server io.github.cyanheads/evals-mcp-server
Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.
-
Git/CI MCP server with the full protocol surface (tools, resources, prompts, roots, sampling).
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
operant-mcp io.github.operantlabs/operant-mcp
Security testing MCP server for penetration testing, forensics, and vulnerability assessment
-
mcp-server io.github.agentmark-ai/mcp-server
Inspect AgentMark traces and drive AgentMark Cloud: apps, experiments, metrics, deployments.
Similar plugins by marketplace
The same question asked of one marketplace at a time: is there an analog of this plugin there?
Has a listing on Claude Code: claude-plugins-community (5)
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
e2e-runner io.github.fastslack/e2e-runner
JSON-driven E2E test runner with parallel Chrome pool execution and 16 MCP tools.
-
agent-discover io.github.keshrath/agent-discover
Find, install and enable MCP servers mid-session on any host, with consent and tool pinning
-
TestMesh MCP server + skills for writing and running E2E integration tests across HTTP, databases, Kafka, gRPC, WebSocket, and more.
-
nodebench io.github.HomenShum/nodebench
260 MCP tools across 49 domains. AI Flywheel, quality gates, research, web scraping.
Has a listing on Claude Code: claude-plugins-official (5)
-
mcp-server io.github.cap-js/mcp-server
Model Context Protocol (MCP) server for AI-assisted development of CAP applications.
-
mdk-mcp-server io.github.SAP/mdk-mcp-server
Model Context Protocol (MCP) server for AI-assisted development of MDK applications.
-
Detect an MCP server's language (Python, TypeScript or Go) and instrument it with the matching Pendo SDK so MCP tool calls flow into Pendo Agent Analytics.
-
Skills for designing and building MCP servers that work seamlessly with Claude. Guides you through deployment models (remote HTTP, MCPB, local), tool design patterns, auth, and…
-
firebase-mcp io.github.firebase/firebase-mcp
Gives AI development tools Firebase-specific capabilities and expertise.
Has a listing on Claude: knowledge-work-plugins (5)
-
MCP server for terminal commands, file operations, and process management
-
Hosted MCP server for AI-assisted Grafana Cloud observability — no local installation required.
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
-
Official SigNoz plugin for MCP setup, docs, queries, dashboards, and alerts
-
gk-cli com.gitkraken/gk-cli
The GitKraken MCP Server for managing repos, PRs, issues across GitHub, GitLab, Bitbucket and more.
Has a listing on Codex: openai-curated (openai/plugins) (5)
-
CrowdStrike Falcon Foundry development skills for building cybersecurity applications on the Falcon platform. Includes UI development, collections, functions, workflows, API…
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Test Android apps with emulator workflows for reproduction, screenshots, UI inspection, log capture, and performance profiling.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
CrowdStrike Falcon Fusion skills for authoring, deploying, and executing Fusion workflows. Includes live action discovery, YAML authoring with schema validation, workflow import…
Has a listing on Community GitHub marketplaces (5)
-
4da-mcp-server io.github.4DA-Systems/4da-mcp-server
Upgrade intelligence for AI agents: what an upgrade changes, where it touches your code, CVE scans.
-
inquisitor io.github.1111111111111111111114oLvT2/inquisitor
Hypothesis-driven problem solving for AI agents: probe, falsify, escalate.
-
MCP server for terminal commands, file operations, and process management
-
HTTP/REST client with saved collections, env secrets, and SSRF-safe host allowlisting.
-
cybersec-toolkit io.github.26zl/cybersec-toolkit
Authorization-gated MCP server to discover and run 670+ security tools for CTF, pentest, and DFIR.
Has a listing on Copilot CLI: github/awesome-copilot (5)
-
Complete toolkit for building Model Context Protocol (MCP) servers in Go using the official github.com/modelcontextprotocol/go-sdk. Includes instructions for best practices, a…
-
Complete toolkit for building Model Context Protocol (MCP) servers in TypeScript/Node.js using the official SDK. Includes instructions for best practices, a prompt for generating…
-
Complete toolkit for building Model Context Protocol (MCP) servers in Kotlin using the official io.modelcontextprotocol:kotlin-sdk library. Includes instructions for best…
-
Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.
-
Comprehensive resources for building Model Context Protocol servers using the official PHP SDK with attribute-based discovery, including best practices, project generation, and…
Has a listing on Copilot CLI: github/copilot-plugins (5)
-
mcp-apps
Generate MCP App widgets for MCP tools. Produces self-contained HTML widgets using the MCP Apps protocol.
-
power-automate
Build, edit, run, and debug Power Automate cloud flows via the FlowAgent MCP server — connection lifecycle, surgical edits, copy across environments, run management, and validated…
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
Has a listing on Cursor: cursor/plugins (5)
-
CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.
-
Fan large tasks out across parallel cloud agents with planners, workers, verifiers, and structured handoffs.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Thermo-nuclear branch review: deep security/correctness audits, harsh code-quality rubrics, parallel subagents, thermos orchestration, and optional merge-ready PR flows.
-
Scaffold and validate new agent plugins.
Has a listing on Docker MCP Catalog (5)
-
testkube-mcp io.github.kubeshop/testkube-mcp
MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants
-
Dynatrace-mcp io.github.dynatrace-oss/Dynatrace-mcp
[DEPRECATED] Dynatrace MCP Server. Migrate to dynatrace-for-ai or Dynatrace Remote MCP Server.
-
MCP server providing Prometheus metrics access and PromQL query execution for AI assistants
-
stackhawk com.stackhawk/stackhawk
An MCP server that provides interaction with StackHawk's security scanning platform.
-
mcp-server-browserbase io.github.browserbase/mcp-server-browserbase
MCP server for AI web browser automation using Browserbase and Stagehand
Has a listing on Official MCP Registry (5)
-
mcp io.github.sapiom/mcp
Local Sapiom developer MCP for authoring, testing, deploying, and inspecting agents.
-
Local test execution and coverage summaries for onboarding agents.
-
meok-mcp-test-mcp io.github.CSOAI-ORG/meok-mcp-test-mcp
MEOK MCP Test MCP — golden-file + schema-drift + tool-failure tests for any MCP server. Drop-in
-
testkube-mcp io.github.kubeshop/testkube-mcp
MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants
-
mcp-agent-trace-inspector io.github.dbsectrainer/mcp-agent-trace-inspector
Step-by-step observability for MCP agent workflows
Found by meaning, not by shared code or a shared repository: similar plugins stay separate products, and this is not a review or a recommendation.
Is this your plugin?
Prove you maintain it with a file in its repository, a file on your domain or a DNS record. You get alerts when a marketplace lists it, drops it, changes its verified mark or what it asks for, and can put its remote endpoint on monitoring as a web service.
Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.