Technical chart with annotated entry, stop-loss and target zones on a dark screen
INVESTIGATIONRisk Management

What Traders Miss When Evaluating a Trading Strategy

The backtest passed. The sample was 40 trades. Here are the eight questions that never get asked.

MarketMaphia Editorial Desk · PUBLISHED 15 Dec 2025 · 8 MIN READ

SHARE

EVIDENCE LABEL — Methodology — evaluation standards

A backtest without methodology is a story with a chart. The equity curve answers 'what happened'; only the methodology answers 'why would it continue'. These are the questions that separate the two.

The eight questions

  • Sample size: how many trades? Under ~100, nearly every statistic is noise-shaped.
  • Out-of-sample: was any data held out, or did the strategy see everything it's scored on?
  • Cost sensitivity: re-run with 1.5x and 2x costs — does the edge survive? If not, the edge IS the cost assumption.
  • Parameter fragility: shift the moving-average length ±20%. If results collapse, you found noise, not a law.
  • Regime coverage: does the test include a trending year and a choppy year?
  • Net vs gross: commissions, spreads, slippage, swap — included and honest?
  • Drawdown path: max drawdown matters more than CAGR for whether you'll actually keep executing.
  • Survivorship: was the instrument universe chosen after knowing what worked?
SPX · 1MSAMPLE DATA
Hover the chart for OHLCV · Monthly candles
DATA IS BY SUPPLIER, VERIFY LIVE MARKET DATA BEFORE TRADING· Illustrative sample data, not live · sample anchor 2026-02-06 · generated 10:09 UTC
Illustrative monthly series: long regimes and sharp transitions are why single-regime backtests systematically mislead. Illustrative sample series — synthetic OHLCV generated for demonstration, not market data.

The report we publish with every strategy study

Instrument and timeframe, exact entry/exit rules, stop logic, target methodology, sample size, test window, gross and net results, cost assumptions, max drawdown, and explicit limitations. Anything less is marketing. Our Strategy Lab hosts the calculators to reproduce every number we publish.

METHODOLOGY

Editorial standard, derived from published quantitative-finance practice on backtest evaluation.

LIMITATIONS

Standards evolve; strategy classes differ (discretionary vs systematic) in what can be tested meaningfully.

DISCLOSURE

This article is independent editorial analysis for information and education. It is not investment advice, a recommendation, or an offer to trade any instrument. Markets involve risk of loss; past or illustrative performance never guarantees future results.

Editorial PolicyCorrectionsRisk Disclosure

#backtesting#methodology#statistics

RISK DISCLOSURE — Trading in securities, currencies, commodities and derivatives involves substantial risk of loss. Content on this site is independent editorial analysis and education, not investment advice or a recommendation. Charts and prices are illustrative sample data unless explicitly attributed otherwise.