canli-mcp / Backtest validation

Data-snooping tests (SPA, Reality Check, StepM)

Data-snooping tests on every variant a search tried: Hansen's SPA p-value that the best beat the benchmark only by luck, White's Reality Check, and the variants Romano-Wolf StepM finds better. Send all variants tried, not only the winners. A deflated Sharpe or overfitting probability above or below any threshold is not admission to anything and is not a forecast.

The tool is validate_reality_check in canli-mcp 0.22.0, free and MIT-licensed, with no account and no API key. It comes from canli-validation-mcp, which canli-mcp includes, and it is also its own server.

Arguments

As the server declares them
ArgumentRequiredType
matrixnonumber[][]
matrix_filenostring
benchmarknonumber[]
block_lengthnointeger
repsnointeger
seednointeger
alphanonumber

How a model reaches it

Ask in plain words. The model finds validate_reality_check with canli-mcp's find_tool, reads its arguments with describe_tool if it needs to, and runs it with run_tool. The call has this shape, with your values in place of the angle brackets:

{
  "name": "validate_reality_check",
  "arguments": {}
}

More

Nothing here is investment advice.