Agent Reliability
Testing, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence
Servidor MCP · de agentreliability.dev
Resumo
Agent Reliability é um servidor MCP publicado por agentreliability.dev. Marketplaces que lemos e que o listam: 1 (Official MCP Registry). Vimos pela primeira vez em 2026-10-11 e não registramos mudanças desde então. Conforme nossa passagem pelos marketplaces em 2026-10-13.
O que pede
- Roda remotamente
Nenhum dos marketplaces que lemos publica as ferramentas ou as configurações que ele pede.
O que declara, pede e executa, por completo
Instale apenas plugins de desenvolvedores em quem você confia. Mostramos o que os marketplaces publicam e não testamos plugins.
Conectar
Sem dados para um comando automático: o que os marketplaces declaram não diz de forma inequívoca como conectá-lo.
Onde está publicado
| Marketplace | Status | Versão | Números | Verificado | Visto pela primeira vez |
|---|---|---|---|---|---|
| Official MCP Registry (Abrir o registro) | Listado | 0.6.14 | Forks (GitHub): 0 Estrelas (GitHub): 0 |
Sem marcação |
Cada número é do próprio marketplace e nunca é somado entre marketplaces. Um marketplace que não publica números não mostra nenhum: sem número não é zero.
O que mudou
Nada mudou neste plugin desde que começamos a acompanhá-lo.
Plugins semelhantes
Produtos cujos próprios nomes, descrições, ferramentas e skills são os mais próximos deste pelo significado, em todos os marketplaces que lemos. A proximidade é ordenada apenas dentro desta lista.
-
Quality verification for AI agents and MCP servers. 6-axis scoring, adversarial probes.
-
mcp io.github.LanceRoylo/mcp
AEO scoring, llms.txt audit, and agent-readiness checks for AI agents.
-
think-mcp net.agentutil/think-mcp
Intent security pre-flight checks for autonomous AI agents.
-
agentos io.github.imran-siddique/agentos
Build and manage policy-compliant AI agents with safety enforcement and compliance checking
-
Human approvals, autonomy limits and a chained audit log for the AI agents of service firms.
-
agent-services-mcp io.github.Gareth1953/agent-services-mcp
MCP server: x402-paid & free tools for AI agents — provenance, quality scoring, action audit.
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
Configure AI agents, give them knowledge and tools, and read back every generation they run.
-
Test whether AI agents retain critical instructions as conversations grow.
-
Test analytics for AI agents: test history, flaky tests, failure clusters, coverage.
Plugins semelhantes por marketplace
A mesma pergunta feita a cada marketplace separadamente: existe lá um equivalente deste plugin?
Listado em Claude Code: claude-plugins-community (5)
-
evalview-mcp io.github.hidai25/evalview-mcp
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
-
vynn-mcp io.github.beee003/vynn-mcp
Self-improving AI workflows with backtesting, prompt optimization, and scheduling
-
eu-ai-act-compliance-mcp io.github.CSOAI-ORG/eu-ai-act-compliance-mcp
Eu Ai Act Compliance MCP Server by MEOK AI Labs
-
deepmiro io.github.kakarot-dev/deepmiro
Simulate hundreds of AI agents to predict how communities react to events and policies
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
Listado em Claude Code: claude-plugins-official (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Build, deploy, and operate AI agents on AWS. Skills for scaffolding agents with Amazon Bedrock AgentCore, connecting tools, memory, policies, evaluation, debugging, and production…
-
Agentforce Agent Development Life Cycle — author, discover, scaffold, deploy, test, and optimize .agent files
-
Skills for tracing, evaluating, and improving AI agents with MLflow. Supports the full agent improvement loop: instrument → trace → evaluate → iterate → validate.
-
firebase-mcp io.github.firebase/firebase-mcp
Gives AI development tools Firebase-specific capabilities and expertise.
Listado em Claude: knowledge-work-plugins (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
-
AI-first project auditor and re-engineer based on the 9 design principles and 7 design patterns from the TechWolf AI-First Bootcamp
-
Connects Claude Code to the Synthflow AI voice-agent platform through its hosted MCP server, with skills for reviewing calls and auditing agent prompts, plus a docs-search…
Listado em Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
CrowdStrike Falcon Foundry development skills for building cybersecurity applications on the Falcon platform. Includes UI development, collections, functions, workflows, API…
-
An agentic skills framework & software development methodology that works: planning, TDD, debugging, and collaboration workflows.
Listado em Community GitHub marketplaces (5)
-
4da-mcp-server io.github.4DA-Systems/4da-mcp-server
Upgrade intelligence for AI agents: what an upgrade changes, where it touches your code, CVE scans.
-
inquisitor io.github.1111111111111111111114oLvT2/inquisitor
Hypothesis-driven problem solving for AI agents: probe, falsify, escalate.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
touchdesigner-mcp-server io.github.8beeeaaat/touchdesigner-mcp-server
MCP server for TouchDesigner - Control and operate TouchDesigner projects through AI agents
-
Build, deploy, and operate AI agents on AWS. Skills for scaffolding agents with Amazon Bedrock AgentCore, connecting tools, memory, policies, evaluation, debugging, and production…
Listado em Copilot CLI: github/awesome-copilot (5)
-
Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.
-
Three-agent workflow for orchestrated software delivery with an orchestrator plus implementation and QA subagents.
-
Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.
-
foundry-hosted-agent-copilotkit
Build CopilotKit + AG-UI web apps on Microsoft Foundry hosted agents (Microsoft Agent Framework): wiring, native Foundry primitives, human-in-the-loop approvals, azd deploy, and…
-
A runtime-portable 5-agent quality gate that adjudicates text artifacts before they ship. Five role-conditioned LLM deliberators run a 2-round async protocol with cross-read…
Listado em Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
power-automate
Build, edit, run, and debug Power Automate cloud flows via the FlowAgent MCP server — connection lifecycle, surgical edits, copy across environments, run management, and validated…
-
mcp-apps
Generate MCP App widgets for MCP tools. Produces self-contained HTML widgets using the MCP Apps protocol.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
-
Advanced Security plugin for GitHub Copilot.
Listado em Cursor: cursor/plugins (5)
-
Patterns for designing CLIs that coding agents can run reliably: flags, help with examples, pipelines, errors, idempotency, dry-run.
-
CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.
-
Fan large tasks out across parallel cloud agents with planners, workers, verifiers, and structured handoffs.
-
Iterative self-referential AI loops using the Ralph Wiggum technique.
-
if you want to go fast, go deep first. pstack helps you write less, but higher quality code. rigorous agent workflows you can parallelize with confidence.
Listado em Docker MCP Catalog (5)
-
Server-enforced workflow discipline for AI agents: work items, dependency graphs, quality gates
-
Wayfound’s MCP server allows business users to govern, supervise, and improve AI Agents.
-
testkube-mcp io.github.kubeshop/testkube-mcp
MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants
-
Discover and connect to a curated marketplace of MCP servers for extending AI agent capabilities.
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
Listado em Official MCP Registry (5)
-
Quality verification for AI agents and MCP servers. 6-axis scoring, adversarial probes.
-
mcp io.github.LanceRoylo/mcp
AEO scoring, llms.txt audit, and agent-readiness checks for AI agents.
-
think-mcp net.agentutil/think-mcp
Intent security pre-flight checks for autonomous AI agents.
-
agentos io.github.imran-siddique/agentos
Build and manage policy-compliant AI agents with safety enforcement and compliance checking
-
Human approvals, autonomy limits and a chained audit log for the AI agents of service firms.
Encontrados pelo significado, não por código ou repositório em comum: plugins semelhantes continuam sendo produtos distintos, e isto não é uma avaliação nem uma recomendação.
Este plugin é seu?
Adicione-o aos seus projetos e prove que o mantém com um arquivo no repositório, um arquivo no seu domínio ou um registro DNS. Você recebe alertas quando um marketplace o publica, o remove, muda a marca de verificado ou o que ele pede, e o endpoint remoto passa a ser monitorado como um serviço web.
Dados de Official MCP Registry. Os números vêm das nossas próprias passagens regulares pelos marketplaces, última leitura em . Não publicamos dados de contato dos editores de plugins.