LLM Prover
Evaluate agent workflows and LLMs on your own data: find wasted steps, pick models, catch drift.
MCP server · by pysolvr.com
About
LLM Prover is an MCP server published by pysolvr.com. Marketplaces we read that list it: 1 (Official MCP Registry). We first saw it on 2026-11-09 and have recorded no change since. As of our marketplace pass on 2026-11-09.
What it asks for
- Runs remotely
None of the marketplaces we read publishes its tools or the settings it asks for.
What it declares, asks for and runs, in full
Only install plugins from developers you trust. We list what marketplaces publish and do not test plugins.
Works with
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
A one-click link opens the client, which asks you to confirm before it adds the server.
From the marketplaces that list it and the MCP transport it declares, as each client documents them. We do not test plugins.
Connect
Commands and configs built only from what its marketplaces declare. We do not run them for you and do not test plugins.
As a remote MCP server
Built from what Official MCP Registry declares.
claude mcp add --transport http llmprover https://mcp.llmprover.pysolvr.com/mcp[mcp_servers.llmprover]
url = "https://mcp.llmprover.pysolvr.com/mcp"{
"mcpServers": {
"llmprover": {
"url": "https://mcp.llmprover.pysolvr.com/mcp"
}
}
}Where it is published
| Marketplace | Status | Version | Figures | Verified | First seen |
|---|---|---|---|---|---|
| Official MCP Registry (Open the registry record) | Listed | 1.0.0 | No figure published | Not marked |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
What changed
- Became a product we track
- Official MCP Registry: appeared
Similar plugins
Products whose own names, descriptions, tools and skills are closest in meaning to this one, on every marketplace we read. Closeness is ranked within this list only.
-
llm-observability-orchestration-agent-langchain-community ai.getvda/llm-observability-orchestration-agent-langchain-community
LLM Observability & Orchestration Agent (LangChain Community)
-
Agent skills for observing and evaluating LLM applications with LangSmith
-
Run a golden set and gate LLM model swaps on accuracy, with latency and cost per request.
-
llm-observability-orchestration-agent-langchain ai.getvda/llm-observability-orchestration-agent-langchain
LLM Observability & Orchestration Agent (Langchain)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
noveum ai.noveum/noveum
Trace, evaluate, and optimize your LLM, RAG, and agent apps with Noveum observability.
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Prompt evals over MCP: run a prompt on your dataset, score each output 1-5 with an LLM judge.
-
Release management and QA for custom AI assistants: RAG, releases, scored QA, signed TrustBench runs
-
VerifiMind PEAS - RefleXion Trinity
X-Z-CS AI validation with auditable reasoning. 8 active tools; 5 in maintenance. v0.5.68
Similar plugins by marketplace
The same question asked of one marketplace at a time: is there an analog of this plugin there?
Has a listing on Claude Code: claude-plugins-community (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
Context engineering plugin for Claude Code — real-time prompt scoring, RLM adaptive weights, and token optimization. Scores every tool use across 5 dimensions (token utilization…
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
Claude model selection advisor — recommends optimal model for each task via shell hook. Zero attack surface.
-
DataRobot Agent Skills - Agentic skills for DataRobot enterprise AI and ML workflows. Covers model training, deployment, predictions, feature engineering, monitoring…
Has a listing on Claude Code: claude-plugins-official (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
Skills for tracing, evaluating, and improving AI agents with MLflow. Supports the full agent improvement loop: instrument → trace → evaluate → iterate → validate.
-
OpenTelemetry observability for Claude Code sessions. Captures tool calls, LLM invocations, token usage, and errors as OTel traces. Send telemetry to Dash0 or any…
Has a listing on Claude: knowledge-work-plugins (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
AI-first project auditor and re-engineer based on the 9 design principles and 7 design patterns from the TechWolf AI-First Bootcamp
-
Build multimodal AI applications with Pixeltable -- tables, computed columns, embedding search, UDFs, tool-calling agents, and 25+ AI provider integrations.
-
Atlan data catalog plugin for Claude Code. Search, explore, govern, and manage your data assets through natural language. Powered by the Atlan MCP server with semantic search…
Has a listing on Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
Answer product and business questions with data
-
Available for US1 customers only. Analyze, investigate, and act on your Datadog telemetry directly from ChatGPT using natural language. Ask questions about your production…
Has a listing on Community GitHub marketplaces (5)
-
Agent skills for observing and evaluating LLM applications with LangSmith
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
langsmith-skills
Collection of LangSmith skills for trace analysis, deployment, and production operations
-
observability
LLM application monitoring including LangSmith and Phoenix. Use when debugging LLM apps or monitoring production systems.
-
Manage prompts in production at scale: prompt versioning, A/B testing, prompt registries, regression prevention, and eval pipelines for production AI features. NOT for writing…
Has a listing on Copilot CLI: github/awesome-copilot (5)
-
Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.
-
Multi-model council for Copilot CLI: three subagents on different model families (Anthropic, OpenAI, Google) answer independently, then build on each other or attack the leading…
-
Three-layer verification pipeline for AI output. Extracts claims, finds sources, and flags hallucination risks so humans can verify before acting.
-
crowdstrike-charlotte-ai-agentworks
CrowdStrike Charlotte AI AgentWorks skills for creating, managing, and invoking AI agents via external Falcon API Gateway endpoints. Includes agent lifecycle management…
-
Microsoft Copilot Studio YAML authoring toolkit. Create, edit, validate, and test Copilot Studio agents using YAML files.
Has a listing on Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
-
workiq-productivity
WorkIQ productivity skills powered by the local WorkIQ CLI — read-only insights across email, meetings, calendar, Teams, SharePoint, projects, and people.
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
Has a listing on Cursor: cursor/plugins (5)
-
Iterative self-referential AI loops using the Ralph Wiggum technique.
-
Ask Databricks Genie questions about your workspace's data in plain language.
-
Incremental transcript-driven memory updates for AGENTS.md using high-signal bullet points only.
-
Fan large tasks out across parallel cloud agents with planners, workers, verifiers, and structured handoffs.
-
Review Trainerize clients and check-ins, and update macros, messages, and programs.
Has a listing on Docker MCP Catalog (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Wayfound’s MCP server allows business users to govern, supervise, and improve AI Agents.
-
Bridges multiple AI models and CLIs, enabling orchestrated workflows across Claude Code, Gemini CLI, Codex CLI, and other AI development tools.
-
Analyze documents, images, videos, and audio.
-
Give your AI agents trusted access to the full Postman platform.
Has a listing on Official MCP Registry (5)
-
llm-observability-orchestration-agent-langchain-community ai.getvda/llm-observability-orchestration-agent-langchain-community
LLM Observability & Orchestration Agent (LangChain Community)
-
Run a golden set and gate LLM model swaps on accuracy, with latency and cost per request.
-
llm-observability-orchestration-agent-langchain ai.getvda/llm-observability-orchestration-agent-langchain
LLM Observability & Orchestration Agent (Langchain)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
noveum ai.noveum/noveum
Trace, evaluate, and optimize your LLM, RAG, and agent apps with Noveum observability.
Has a listing on PyPI (MCP servers) (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
Read, measure and explain LLM eval runs of a digline suite. Cannot promote a baseline.
-
Langfuse MCP server for accessing and analyzing telemetry data via natural language
-
marm-mcp-server io.github.Lyellr88/marm-mcp-server
Universal MCP Server with advanced AI memory capabilities and semantic search.
-
air-blackbox-mcp io.github.airblackbox/air-blackbox-mcp
EU AI Act compliance scanner for Python AI agents. 14 tools across 6 articles.
Has a listing on npm registry (MCP servers) (5)
-
rubber-duck io.github.nesquikm/rubber-duck
Bridge to multiple LLMs and CLI agents: councils, debates, voting, and more
-
Context Assurance for AI agents: context engineering, AI cost optimization, verification.
-
claude-prompts-mcp io.github.minipuft/claude-prompts-mcp
Reusable prompt templates, multi-step workflow chains, and quality gates for any MCP client.
-
140 deterministic tools for your AI: logs, tests, SQL, diagrams, SPARQL. Local, no network.
-
Contextual prompts and agent skills for 140+ AI platforms.
Found by meaning, not by shared code or a shared repository: similar plugins stay separate products, and this is not a review or a recommendation.
Want this mark on your plugin in our catalog?
Prove you maintain it with a file in its repository, a file on your domain or a DNS record, and you can show this mark on the card, with live banners for your site and README. How verification works
You also get alerts when a marketplace lists it, drops it, changes its verified mark or what it asks for, and its remote endpoint goes on monitoring as a web service.
Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.