canli-mcp / Backtest validation

Test a research pipeline on placebo data

Does your pipeline find edges in noise? plan writes placebo files (your data's returns in random orders, so nothing is predictable); run the whole pipeline on real.csv and on each, then compare for a p-value that counts every choice it makes. Beating the placebos shows the pipeline finds more in the real order of the returns than in random orders of the same returns; it does not show the edge survives costs, capacity or the future.

The tool is placebo_test in canli-mcp 0.22.0, free and MIT-licensed, with no account and no API key. It comes from canli-validation-mcp, which canli-mcp includes, and it is also its own server.

Arguments

As the server declares them
ArgumentRequiredType
actionyesplan|compare
data_filenostring
columnsnoobject
kindnoprices|returns
placebosnointeger
methodnopermute|block_permute|stationary_bootstrap
seednointeger
realnonumber
placebo_resultsnonumber[]
lower_is_betternoboolean

How a model reaches it

Ask in plain words. The model finds placebo_test with canli-mcp's find_tool, reads its arguments with describe_tool if it needs to, and runs it with run_tool. The call has this shape, with your values in place of the angle brackets:

{
  "name": "placebo_test",
  "arguments": {
    "action": "<plan|compare>"
  }
}

More

Nothing here is investment advice.