Ext Ops Panel
Open dashboard
Comparison

memoriant-eval-sandbox-skill vs io.github.ipezygj/evalgate

memoriant-eval-sandbox-skill is a plugin bundle for AI coding tools published by NathanMaine. Marketplaces we read that list it: 1 (Claude Code: claude-plugins-community). io.github.ipezygj/evalgate is an MCP server published by ipezygj. Marketplaces we read that list it: 1 (Official MCP Registry). As of our marketplace pass on 2026-10-24. This pair was picked by a reader, not by our comparison rule, so search engines are asked not to index the page.

Where each is published

Where each is published
Marketplacememoriant-eval-sandbox-skillio.github.ipezygj/evalgate
Claude Code: claude-plugins-community Listed
Version: 1.0.0
Forks (GitHub): 0
Stars (GitHub): 0
Not marked · First seen
Not listed
Official MCP Registry Not listed Listed
Version: 0.4.1
No figure published
Not marked · First seen

Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.

The facts side by side

memoriant-eval-sandbox-skill vs io.github.ipezygj/evalgate
Factmemoriant-eval-sandbox-skillio.github.ipezygj/evalgate
Marketplaces that list it11
Stars (GitHub) (differs)0No figure on GitHub
Forks (GitHub) (differs)0No figure on GitHub
Last releaseNot publishedNot published
Where it runs (differs)Installs as a plugin bundleOn your machine (eval-integrity)
Transport (differs)Not statedstdio
Tools it declaresNot publishedNot published
Environment variables it asks forNot publishedNot published
Parts of the bundle (differs)2Not a bundle
Licence (differs)MITNot stated
Repository (differs)github.com/nathanmaine/memoriant-eval-sandbox-skillgithub.com/ipezygj/evalgate
Changes in the last 7 days00
First seen2026-10-112026-10-11

Lines where the two differ have a tinted background and bold values. Where the data itself says which value is better (more marketplaces, a larger figure of the same marketplace, a fresher release, a verified mark on a marketplace that lists both), the better one is also marked green with ▲ and the worse one red with ▼. Where it runs, the transport, the tools, the settings, hooks, the bundle's parts, the licence and the week's changes are marked only as different: more or fewer is not better in itself.

What each says it does

memoriant-eval-sandbox-skill

In its own words, on Claude Code: claude-plugins-community:

AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit trails with integrity hashes. Test your agents before deploying them. Includes full Python evaluation framework.

io.github.ipezygj/evalgate

In its own words, on Official MCP Registry:

Statistical checks an agent runs before trusting an AI eval number (is #1 real, judge bias, more).

How to run each

memoriant-eval-sandbox-skill As a Claude Code plugin

Claude Code
/plugin marketplace add anthropics/claude-plugins-community
/plugin install memoriant-eval-sandbox-skill@claude-community

io.github.ipezygj/evalgate As a local MCP server: PyPI package

Claude Code
claude mcp add --transport stdio evalgate -- uvx eval-integrity

Commands built only from what the marketplaces declare; the full set for every client is on each card.

Tools each declares

Neither one's marketplaces publish a list of tools, so there is nothing to compare.

Settings each asks for

Neither one's marketplaces publish the settings it asks for.

What it can do: memoriant-eval-sandbox-skill · What it can do: io.github.ipezygj/evalgate · Compare two other plugins

Data comes from the public marketplace file https://github.com/anthropics/claude-plugins-community/blob/HEAD/.claude-plugin/marketplace.json. Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.

Where the data comes from: how the catalog is built