Plugin Eval vs GAIP Procurement Evidence Agent
Plugin Eval is a plugin bundle for AI coding tools published by OpenAI Codex. Marketplaces we read that list it: 1 (Codex: openai-curated (openai/plugins)). GAIP Procurement Evidence Agent is an MCP server published by tjcgraham-rgb. Marketplaces we read that list it: 1 (Official MCP Registry). As of our marketplace pass on 2026-10-18. This pair was picked by a reader, not by our comparison rule, so search engines are asked not to index the page.
Where each is published
| Marketplace |  GAIP Procurement Evidence Agent | |
|---|---|---|
| Codex: openai-curated (openai/plugins) | Listed Version: 0.1.2 Forks (GitHub): 974 Stars (GitHub): 7 492 Not marked · First seen |
Not listed |
| Official MCP Registry | Not listed | Listed Version: 1.5.0 Forks (GitHub): 0 Stars (GitHub): 0 Not marked · First seen |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
The facts side by side
| Fact | Plugin Eval | GAIP Procurement Evidence Agent |
|---|---|---|
| Marketplaces that list it | 1 | 1 |
| Stars (GitHub) (differs) | 7 492 (better) | 0 (worse) |
| Forks (GitHub) (differs) | 974 (better) | 0 (worse) |
| Last release | Not published | Not published |
| Where it runs (differs) | Installs as a plugin bundle | Remote server (www.gaipagents.com/mcp/agents/procurement-verify) |
| Transport (differs) | Not stated | Streamable HTTP |
| Tools it declares | Not published | Not published |
| Environment variables it asks for | Not published | Not published |
| Parts of the bundle (differs) | 5 | Not a bundle |
| Licence (differs) | MIT | Not stated |
| Repository (differs) | github.com/openai/plugins | github.com/tjcgraham-rgb/gaip-agents |
| Changes in the last 7 days | 0 | 0 |
| First seen | 2026-10-11 | 2026-10-11 |
| Endpoint at the last check (differs) | no remote endpoint we check | Responded 2 days ago |
Lines where the two differ have a tinted background and bold values. Where the data itself says which value is better (more marketplaces, a larger figure of the same marketplace, a fresher release, a verified mark on a marketplace that lists both), the better one is also marked green with ▲ and the worse one red with ▼. Where it runs, the transport, the tools, the settings, hooks, the bundle's parts, the licence and the week's changes are marked only as different: more or fewer is not better in itself.
What each says it does
Plugin Eval
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
GAIP Procurement Evidence Agent
Now part of GAIP Witness: tests supplier claims and compares them with published metadata.
How to run each
Plugin Eval As a Codex plugin
codex plugin marketplace add openai/pluginsGAIP Procurement Evidence Agent As a remote MCP server
claude mcp add --transport http gaip-procurement-verify https://www.gaipagents.com/mcp/agents/procurement-verifyCommands built only from what the marketplaces declare; the full set for every client is on each card.
Only GAIP Procurement Evidence Agent has a remote endpoint we check. How we check endpoints
Tools each declares
Neither one's marketplaces publish a list of tools, so there is nothing to compare.
Settings each asks for
Neither one's marketplaces publish the settings it asks for.
What it can do: Plugin Eval · What it can do: GAIP Procurement Evidence Agent · Compare two other plugins
Data comes from the public marketplace file https://github.com/openai/plugins/blob/HEAD/.agents/plugins/marketplace.json. Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.