eval-guide vs memoriant-eval-sandbox-skill
eval-guide is a plugin bundle for AI coding tools published by microsoft. Marketplaces we read that list it: 1 (Community GitHub marketplaces). memoriant-eval-sandbox-skill is a plugin bundle for AI coding tools published by NathanMaine. Marketplaces we read that list it: 1 (Claude Code: claude-plugins-community). As of our marketplace pass on 2026-11-06. This pair was picked by a reader, not by our comparison rule, so search engines are asked not to index the page.
Where each is published
| Marketplace |  eval-guide |  memoriant-eval-sandbox-skill |
|---|---|---|
| Community marketplace microsoft/eval-guide | Listed Version: 1.0.0 Forks (GitHub): 22 Stars (GitHub): 140 Not marked · First seen |
Not listed |
| Claude Code: claude-plugins-community | Not listed | Listed Version: 1.0.0 Forks (GitHub): 0 Stars (GitHub): 0 Not marked · First seen |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
The facts side by side
| Fact | eval-guide | memoriant-eval-sandbox-skill |
|---|---|---|
| Marketplaces that list it | 1 | 1 |
| Stars (GitHub) (differs) | 140 (better) | 0 (worse) |
| Forks (GitHub) (differs) | 22 (better) | 0 (worse) |
| Last release | Not published | Not published |
| Where it runs | Installs as a plugin bundle | Installs as a plugin bundle |
| Transport | Not stated | Not stated |
| Tools it declares | Not published | Not published |
| Environment variables it asks for | Not published | Not published |
| Parts of the bundle (differs) | 6 | 2 |
| Licence (differs) | Not stated | MIT |
| Repository (differs) | github.com/microsoft/eval-guide | github.com/nathanmaine/memoriant-eval-sandbox-skill |
| Changes in the last 7 days | 0 | 0 |
| First seen (differs) | 2026-10-28 | 2026-10-11 |
Lines where the two differ have a tinted background and bold values. Where the data itself says which value is better (more marketplaces, a larger figure of the same marketplace, a fresher release, a verified mark on a marketplace that lists both), the better one is also marked green with ▲ and the worse one red with ▼. Where it runs, the transport, the tools, the settings, hooks, the bundle's parts, the licence and the week's changes are marked only as different: more or fewer is not better in itself.
What each says it does
eval-guide
AI agent evaluation toolkit for Copilot Studio. Plan evals, generate test cases, interpret results, and triage failures.
memoriant-eval-sandbox-skill
AI agent evaluation sandbox for Claude Code. Holdout scenario testing with Doer/Judge/Adversary/Observer roles, probabilistic satisfaction scoring, and append-only JSONL audit trails with integrity hashes. Test your agents before deploying them. Includes full Python evaluation framework.
How to run each
eval-guide As a Claude Code plugin
/plugin marketplace add microsoft/eval-guide
/plugin install eval-guide@eval-guidememoriant-eval-sandbox-skill As a Claude Code plugin
/plugin marketplace add anthropics/claude-plugins-community
/plugin install memoriant-eval-sandbox-skill@claude-communityCommands built only from what the marketplaces declare; the full set for every client is on each card.
Tools each declares
Neither one's marketplaces publish a list of tools, so there is nothing to compare.
Settings each asks for
Neither one's marketplaces publish the settings it asks for.
What it can do: eval-guide · What it can do: memoriant-eval-sandbox-skill · Compare two other plugins
Data comes from public marketplace files in GitHub repositories of their authors. Data comes from the public marketplace file https://github.com/anthropics/claude-plugins-community/blob/HEAD/.claude-plugin/marketplace.json. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.