canli-mcp / Backtest validation
Data-snooping tests (SPA, Reality Check, StepM)
Data-snooping tests on every variant a search tried: Hansen's SPA p-value that the best beat the benchmark only by luck, White's Reality Check, and the variants Romano-Wolf StepM finds better. Send all variants tried, not only the winners. A deflated Sharpe or overfitting probability above or below any threshold is not admission to anything and is not a forecast.
The tool is validate_reality_check in canli-mcp 0.22.0, free and MIT-licensed, with no account and no API key. It comes from canli-validation-mcp, which canli-mcp includes, and it is also its own server.
Arguments
| Argument | Required | Type |
|---|---|---|
matrix | no | number[][] |
matrix_file | no | string |
benchmark | no | number[] |
block_length | no | integer |
reps | no | integer |
seed | no | integer |
alpha | no | number |
How a model reaches it
Ask in plain words. The model finds validate_reality_check with canli-mcp's find_tool, reads its arguments with describe_tool if it needs to, and runs it with run_tool. The call has this shape, with your values in place of the angle brackets:
{
"name": "validate_reality_check",
"arguments": {}
}More
Nothing here is investment advice.