Backtest Overfitting Audit
Probability of Backtest Overfitting (CSCV), Deflated Sharpe Ratio, and purged CV splits.
MCP server · by tylerscomic-lab
About
Backtest Overfitting Audit is an MCP server published by tylerscomic-lab. Marketplaces we read that list it: 1 (Official MCP Registry). We first saw it on 2026-10-11 and have recorded no change since. As of our marketplace pass on 2026-10-13.
What it asks for
- Runs remotely
None of the marketplaces we read publishes its tools or the settings it asks for.
What it declares, asks for and runs, in full
Only install plugins from developers you trust. We list what marketplaces publish and do not test plugins.
Works with
- Claude Code
- Codex
- Cursor
- VS Code
- Copilot CLI
A one-click link opens the client, which asks you to confirm before it adds the server.
From the marketplaces that list it and the MCP transport it declares, as each client documents them. We do not test plugins.
Connect
Commands and configs built only from what its marketplaces declare. We do not run them for you and do not test plugins.
As a remote MCP server
Built from what Official MCP Registry declares.
claude mcp add --transport http overfitting-audit-mcp https://overfitting-audit-mcp.mcpize.run/mcp[mcp_servers.overfitting-audit-mcp]
url = "https://overfitting-audit-mcp.mcpize.run/mcp"{
"mcpServers": {
"overfitting-audit-mcp": {
"url": "https://overfitting-audit-mcp.mcpize.run/mcp"
}
}
}Where it is published
| Marketplace | Status | Version | Figures | Verified | First seen |
|---|---|---|---|---|---|
| Official MCP Registry (Open the registry record) | Listed | 1.0.0 | Forks (GitHub): 0 Stars (GitHub): 0 |
Not marked |
Each figure is the marketplace's own and is never added up across marketplaces. A marketplace that publishes no figure shows none: no number is not zero.
What changed
Nothing has moved on this plugin since we started watching it.
Similar plugins
Products whose own names, descriptions, tools and skills are closest in meaning to this one, on every marketplace we read. Closeness is ranked within this list only.
-
Verify trading-strategy backtests: look-ahead probes, trading costs, Deflated Sharpe, walk-forward.
-
Monte Carlo Backtest Validator
Bootstrap Monte Carlo backtest validation and prop-firm challenge pass-probability simulation.
-
Walk-Forward Efficiency, parameter-stability scoring, and WFO window generation.
-
mcp com.alphaassay/mcp
Fail-closed backtest/signal validation: overfitting, leakage, deflated Sharpe. NOT financial advice.
-
grader ai.tessen/grader
Honest A-F grades for trading strategies, backtested on real out-of-sample data. No hype.
-
regimen io.github.RaYYeR220/regimen
Tells you whether a trading strategy's edge is distinguishable from luck.
-
Pancake — Verifiable Backtests for AI Agents
Verifiable backtests for AI-built trading strategies: deterministic engine, reproducible results.
-
Deterministic stock screening, backtesting, and factor analysis for AI trading agents
-
Portfolio risk analytics — VaR, Monte Carlo, optimization, options Greeks, stress testing.
-
Backtest NIFTY option strategies on real 1-minute data, with an honest out-of-sample panel.
Similar plugins by marketplace
The same question asked of one marketplace at a time: is there an analog of this plugin there?
Has a listing on Claude Code: claude-plugins-community (5)
-
vynn-mcp io.github.beee003/vynn-mcp
Self-improving AI workflows with backtesting, prompt optimization, and scheduling
-
swallow-insurance-rating-engine
Build, validate, analyse, and test insurance rating models with the Swallow Rating Engine via MCP
-
A causal inference plugin for AI agents. Describe a problem in plain language and it helps you choose a method, check assumptions, write the analysis in R or Python, and…
-
Forensic Quality-of-Earnings primitives as a standalone Claude plugin: Beneish M-Score, Benford's Law, EBITDA bridge, journal-entry testing, lapping detection, and working-capital…
-
Persistent memory + autonomous strategy evolution for AI traders. Records every trade with full context across 5 memory layers (episodic, semantic, procedural, strategic…
Has a listing on Claude Code: claude-plugins-official (5)
-
Skills for adding DeepEval evaluations, tracing, datasets, Confident AI reports, and iterative improvement loops to AI applications.
-
CodSpeed is the all-in-one performance testing toolkit. Dive into benchmarking results, flamegraphs, and performance comparisons — give Claude granular profiling context to…
-
Find the right NVIDIA skill for GPU acceleration, CUDA, AI agents, data loading, training, inference, robotics, Physical AI, Omniverse, simulation, and other NVIDIA-powered…
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
Has a listing on Claude: knowledge-work-plugins (5)
-
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
-
DataRobot skills for AI/ML workflows — model training, deployment, predictions, feature engineering, monitoring, explainability, data preparation, App Framework CI/CD, and…
-
Portfolio monitoring and analytics for private-capital LP teams using the Chronograph connector: cashflow forecasting, commitment pacing, look-through exposure scans and…
-
A suite of agent skills for the full GrowthBook feature flag and experimentation lifecycle.
-
blackrock-advisor-center-plugin
BlackRock Advisor Center 360° skills for financial advisors: portfolio review, opportunity and fund-health checks, guided benchmark selection, guided portfolio building, wealth…
Has a listing on Codex: openai-curated (openai/plugins) (5)
-
Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.
-
Predict structures, screen molecules and proteins, and design binders.
-
Skills for NVIDIAs ecosystem spans GPU acceleration, CUDA, AI agents, inference, robotics, Physical AI, Omniverse, and simulation. This plugin helps you understand the pieces…
-
Codex Security workflows for security scans, analysis, and investigation.
-
Answer product and business questions with data
Has a listing on Community GitHub marketplaces (5)
-
Check classifier confidence against accuracy, fit temperature scaling and save local reports.
-
ai-architect-mcp-spec io.github.cdeust/ai-architect-mcp-spec
PRD verification and host-driven generation with multi-judge consensus across 17 MCP tools.
-
Finds what shipped after your coding agent's training, before it rebuilds it from scratch.
-
Verify PyPI and npm packages, symbols, and version diffs against real artifacts. Free, no account.
-
Option analytics an agent can drive: chains, the full Greek ladder, dealer positioning, twenty-three structures with ranking, a GARCH-t simulation, backtests with modelled…
Has a listing on Copilot CLI: github/awesome-copilot (5)
-
Visualizes live session AI-credit usage as a Pac-Man board with pellets, ghosts, fruit milestones, and game-over limits.
-
Three-layer verification pipeline for AI output. Extracts claims, finds sources, and flags hallucination risks so humans can verify before acting.
-
Explore and query TimeBase streams, schemas, QQL, symbols, and server status via MCP.
-
Safe BLE diagnostics, evidence workflows, and guarded automation for AI agents.
-
A runtime-portable 5-agent quality gate that adjudicates text artifacts before they ship. Five role-conditioned LLM deliberators run a 2-round async protocol with cross-read…
Has a listing on Copilot CLI: github/copilot-plugins (5)
-
Analyze MSVC build performance using vcperf.exe and ETL traces.
-
Advanced Security plugin for GitHub Copilot.
-
Toolkit for building Microsoft 365 Copilot declarative agents — scaffolding, JSON manifest development, and capability configuration.
-
mcp-apps
Generate MCP App widgets for MCP tools. Produces self-contained HTML widgets using the MCP Apps protocol.
-
Build Power Apps Canvas Apps using the Canvas Authoring MCP server.
Has a listing on Cursor: cursor/plugins (5)
-
Inspect and manage feature gates, experiments, dynamic configs, and metrics.
-
playwright-mcp io.github.microsoft/playwright-mcp
Playwright Tools for MCP
-
Work with PostHog from chat: query product analytics and run SQL, manage feature flags and experiments, triage error tracking issues, and review session replays, surveys, and…
-
CLI-backed repo compatibility scans plus agents that audit startup, validation, and docs against reality.
-
Track AI visibility, sentiment, and citations.
Has a listing on Docker MCP Catalog (5)
-
Read and score Opik traces, experiments, datasets and prompts from your AI assistant.
-
The QuantConnect MCP Server is a bridge for AIs (such as Claude and OpenAI o3 Pro) to interact with our cloud platform. When equipped with our MCP, the AI can perform tasks on…
-
The Official Model Context Protocol (MCP) server for Kagi Search & other tools.
-
Analyze code quality and security with SonarQube Server or Cloud directly in AI assistants.
-
MCP server for AI access to SmartBear tools, including BugSnag, Reflect, Swagger, PactFlow, QTM4J.
Has a listing on Official MCP Registry (5)
-
Verify trading-strategy backtests: look-ahead probes, trading costs, Deflated Sharpe, walk-forward.
-
Monte Carlo Backtest Validator
Bootstrap Monte Carlo backtest validation and prop-firm challenge pass-probability simulation.
-
Walk-Forward Efficiency, parameter-stability scoring, and WFO window generation.
-
mcp com.alphaassay/mcp
Fail-closed backtest/signal validation: overfitting, leakage, deflated Sharpe. NOT financial advice.
-
grader ai.tessen/grader
Honest A-F grades for trading strategies, backtested on real out-of-sample data. No hype.
Found by meaning, not by shared code or a shared repository: similar plugins stay separate products, and this is not a review or a recommendation.
Is this your plugin?
Add it to your projects and prove you maintain it with a file in its repository, a file on your domain or a DNS record. You get alerts when a marketplace lists it, drops it, changes its verified mark or what it asks for, and its remote endpoint goes on monitoring as a web service.
Data comes from the Official MCP Registry (registry.modelcontextprotocol.io), CC0 1.0. Figures come from our own regular passes over the marketplaces, last read on . We publish no contact details for plugin publishers.