# Wansiri Statistical Validation ## Overview A profitable historical backtest does not necessarily demonstrate that a trading strategy has a genuine or repeatable source of profitability. When many strategies and configurations are evaluated, apparently successful results can arise through chance, selection bias or overfitting. Wansiri uses statistical validation to assess whether historical performance provides credible evidence before strategies progress further through the research process. The objective is to distinguish statistically robust results from performance that depends on testing methodology or historical circumstances. ## Why Statistical Validation Matters Traditional backtesting can produce misleading results when large numbers of configurations are tested. The more alternatives evaluated, the greater the opportunity to find apparently successful results by chance. A strategy's historical profitability must therefore be considered alongside the statistical reliability of the evidence supporting it. ## Validation Approach Wansiri applies a multi-stage validation process that assesses the statistical credibility of historical results, their robustness to changes in assumptions, and their consistency through time. Results are also considered alongside whether there is a credible underlying market rationale for the observed behaviour. Strategies that do not meet the validation requirements do not progress through the research process. ## Evidence from Internal Research Wansiri's internal research applying this process to historical cryptocurrency strategy evaluations found that a substantial majority of apparently testable configurations did not satisfy the validation requirements. This illustrates why historical profitability alone is insufficient evidence of strategy quality. ## Statistical Validation and Production Statistical validation is a research-stage assessment. Passing it does not guarantee that a strategy will perform in live markets. Production introduces additional considerations, including current market conditions and execution behaviour. Wansiri therefore treats statistical validation as an important prerequisite for further consideration, not a guarantee of production performance. ## Summary Wansiri's statistical validation process is designed to assess whether historical performance represents credible evidence rather than an artefact of extensive testing or historical selection. This applies additional scrutiny before strategies progress towards production. The governing principle is: **A profitable backtest is the beginning of research, not proof of a viable trading strategy.**