io.github.Alberto-Codes/judgevet
Ask TypeSafe Jev yes/no, choice and score questions and receive structured model judgments.
MCP server · by Alberto-Codes
About
io.github.Alberto-Codes/judgevet is an MCP server published by Alberto-Codes. Marketplaces we read that list it: 1 (Official MCP Registry). We first saw it on 2026-10-11 and have recorded no change since. As of our marketplace pass on 2026-10-13.
What it asks for
- Runs on your machine
- Secrets: 1
- Settings: 1
Requires: JEV_API__KEY (secret)
What it declares, asks for and runs, in full
Only install plugins from developers you trust. We list what marketplaces publish and do not test plugins.
Works with
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
From the marketplaces that list it and the MCP transport it declares, as each client documents them. We do not test plugins.
Connect
Commands and configs built only from what its marketplaces declare. We do not run them for you and do not test plugins.
As a local MCP server: PyPI package
Built from what Official MCP Registry declares.
claude mcp add --env "JEV_API__KEY=<YOUR_JEV_API__KEY>" --transport stdio judgevet -- uvx --from "judgevet[mcp]==<YOUR_VERSION>" judgevet-mcp judgevet[mcp_servers.judgevet]
command = "uvx"
args = ["--from", "judgevet[mcp]==<YOUR_VERSION>", "judgevet-mcp", "judgevet"]
[mcp_servers.judgevet.env]
JEV_API__KEY = "<YOUR_JEV_API__KEY>"{
"mcpServers": {
"judgevet": {
"command": "uvx",
"args": [
"--from",
"judgevet[mcp]==<YOUR_VERSION>",
"judgevet-mcp",
"judgevet"
],
"env": {
"JEV_API__KEY": "<YOUR_JEV_API__KEY>"
}
}
}
}Replace the values in angle brackets with your own. We show the names of the settings, never values.
Where it is published
| Marketplace | Status | Version | Figures | Verified | First seen |
|---|---|---|---|---|---|
| Official MCP Registry (Open the registry record) | Listed | 0.20.0 | Forks (GitHub): 0 Stars (GitHub): 0 |
Not marked |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
What changed
Nothing has moved on this plugin since we started watching it.
Similar plugins
Products whose own names, descriptions, tools and skills are closest in meaning to this one, on every marketplace we read. Closeness is ranked within this list only.
-
jev-use io.github.shitianfang/jev-use
Typed yes/no, pick-one and score judgments from Jev in one batched call; typed escalation back.
-
poordjaevin io.github.Icaro0310/poordjaevin
Typed answers with calibrated confidence for agents. Local-first, no API key.
-
Evaluate state with typed choice, score, and probability questions.
-
Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.
-
jev-decision-mcp io.github.amidabuddha/jev-decision-mcp
Typed Jev decisions in one batched tool: choice, score, and yes/no probabilities.
-
argus-decision-mcp io.github.commet/argus-decision-mcp
Preserve a user-authorized judgment and append later answers. No model verdict or human score.
-
Prompt evals over MCP: run a prompt on your dataset, score each output 1-5 with an LLM judge.
-
SomaCheck returns proposition-specific Aligned or Unaligned plus model confidence.
-
Host-neutral MCP bridge for TypeSafe AI Jev judgments with typed review, routing, and gate tools.
-
hone io.github.derekchoyai/hone
Score your judgment over AI-assisted work. Hone scores you, not the model.
Similar plugins by marketplace
The same question asked of one marketplace at a time: is there an analog of this plugin there?
Has a listing on Claude Code: claude-plugins-community (5)
-
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit…
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
LGBTQIA+ safety tools for LLM engineers — audit prompts, review code, and catch harms before you ship
-
Convergent Socratic interview with mathematical ambiguity gating. 8-15 narrowing rounds + Contrarian/Simplifier Challenge Mode + JSONL decision log. Inspired by Sorbh/interview-me.
-
Context engineering plugin for Claude Code — real-time prompt scoring, RLM adaptive weights, and token optimization. Scores every tool use across 5 dimensions (token utilization…
Has a listing on Claude Code: claude-plugins-official (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
OpenTelemetry observability for Claude Code sessions. Captures tool calls, LLM invocations, token usage, and errors as OTel traces. Send telemetry to Dash0 or any…
-
Output.ai workflow development toolkit for Claude Code. Adds 5 specialist agents (planner, builder, debugger, prompt writer, quality reviewer), 40+ slash-command skills covering…
-
Langfuse observability plugin for Claude Code — captures and exports traces, spans, and session telemetry from Claude Code to Langfuse for LLM monitoring, debugging, and evaluation
Has a listing on Claude: knowledge-work-plugins (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
The Vanta plugin connects Claude Code to Vanta's security and compliance platform through the Vanta MCP server. It combines Vanta's test-specific remediation intelligence with…
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
Build multimodal AI applications with Pixeltable -- tables, computed columns, embedding search, UDFs, tool-calling agents, and 25+ AI provider integrations.
-
Figma design platform integration. Access design files, extract component information, read design tokens, and translate designs into code. Bridge the gap between design and…
Has a listing on Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Build with OpenAI APIs, Agents SDK, and ChatGPT Apps, and create and save OpenAI API keys from Codex.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
Answer product and business questions with data
-
PostHog gives your AI agent direct access to your product analytics, feature flags, experiments, error tracking, surveys, logs, and LLM analytics. Ask questions about your data…
Has a listing on Community GitHub marketplaces (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
Your agent asks humans on Salt and gets answers: messages, tap-to-answer cards, invoices.
-
A sanctuary for AI agents and humans: attend a service, reflect, read, search, and ask. No auth.
-
Dash0 Observability
OpenTelemetry observability for OpenAI Codex sessions. Captures prompts, tool calls, MCP calls, sub-agent activity, and token usage as OTel traces.
-
Create and retrieve from a Foundry IQ knowledge base using File, Azure Blob, or ADLS Gen2, then connect an existing Prompt or Hosted Agent.
Has a listing on Copilot CLI: github/awesome-copilot (5)
-
Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.
-
Three-layer verification pipeline for AI output. Extracts claims, finds sources, and flags hallucination risks so humans can verify before acting.
-
Codebase-grounded concept-mastery quizzes with an interactive BrainMax Canvas dashboard.
-
Visualizes live session AI-credit usage as a Pac-Man board with pellets, ghosts, fruit milestones, and game-over limits.
-
Run a lightweight, role-separated AI development team with flexible tools, developer-selected models, proportionate planning, and optional QA.
Has a listing on Copilot CLI: github/copilot-plugins (5)
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
workiq
Query Microsoft 365 data with natural language — emails, meetings, documents, Teams messages, and more.
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
-
model-apps
Build and deploy Power Apps generative pages for model-driven apps with specialist agents for planning, entity creation, and parallel code generation. Requires PAC CLI >= 2.7.0…
-
workiq-productivity
WorkIQ productivity skills powered by the local WorkIQ CLI — read-only insights across email, meetings, calendar, Teams, SharePoint, projects, and people.
Has a listing on Cursor: cursor/plugins (5)
-
Search company knowledge and draft verified answers.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Iterative self-referential AI loops using the Ralph Wiggum technique.
-
Work with PostHog from chat: query product analytics and run SQL, manage feature flags and experiments, triage error tracking issues, and review session replays, surveys, and…
-
Build apps, scripts, and automations with the TypeScript SDK.
Has a listing on Docker MCP Catalog (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
The Official Model Context Protocol (MCP) server for Kagi Search & other tools.
-
Analyze code quality and security with SonarQube Server or Cloud directly in AI assistants.
-
MCP server for AI access to SmartBear tools, including BugSnag, Reflect, Swagger, PactFlow, QTM4J.
-
Bridges multiple AI models and CLIs, enabling orchestrated workflows across Claude Code, Gemini CLI, Codex CLI, and other AI development tools.
Has a listing on Official MCP Registry (5)
-
jev-use io.github.shitianfang/jev-use
Typed yes/no, pick-one and score judgments from Jev in one batched call; typed escalation back.
-
poordjaevin io.github.Icaro0310/poordjaevin
Typed answers with calibrated confidence for agents. Local-first, no API key.
-
Evaluate state with typed choice, score, and probability questions.
-
Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.
-
jev-decision-mcp io.github.amidabuddha/jev-decision-mcp
Typed Jev decisions in one batched tool: choice, score, and yes/no probabilities.
Found by meaning, not by shared code or a shared repository: similar plugins stay separate products, and this is not a review or a recommendation.
Is this your plugin?
Add it to your projects and prove you maintain it with a file in its repository, a file on your domain or a DNS record. You get alerts when a marketplace lists it, drops it, changes its verified mark or what it asks for, and its remote endpoint goes on monitoring as a web service.
Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.