canli-mcp / Backtest validation
Test a research pipeline on placebo data
Does your pipeline find edges in noise? plan writes placebo files (your data's returns in random orders, so nothing is predictable); run the whole pipeline on real.csv and on each, then compare for a p-value that counts every choice it makes. Beating the placebos shows the pipeline finds more in the real order of the returns than in random orders of the same returns; it does not show the edge survives costs, capacity or the future.
The tool is placebo_test in canli-mcp 0.22.0, free and MIT-licensed, with no account and no API key. It comes from canli-validation-mcp, which canli-mcp includes, and it is also its own server.
Arguments
| Argument | Required | Type |
|---|---|---|
action | yes | plan|compare |
data_file | no | string |
columns | no | object |
kind | no | prices|returns |
placebos | no | integer |
method | no | permute|block_permute|stationary_bootstrap |
seed | no | integer |
real | no | number |
placebo_results | no | number[] |
lower_is_better | no | boolean |
How a model reaches it
Ask in plain words. The model finds placebo_test with canli-mcp's find_tool, reads its arguments with describe_tool if it needs to, and runs it with run_tool. The call has this shape, with your values in place of the angle brackets:
{
"name": "placebo_test",
"arguments": {
"action": "<plan|compare>"
}
}More
Nothing here is investment advice.