Learn / Risk management

Back to learn

Answer page / risk management

Topic cluster / Signal and portfolio design

What metrics matter most for binary signal strategies?

For binary signal strategies, hit rate alone is not enough. You need to know base rate, calibration, average edge after costs, opportunity frequency, turnover, and whether the trigger is adding value beyond a simpler continuous-score policy.

What to remember

  • Base rate and signal frequency
  • Precision, recall, and calibration if the trigger comes from a probability model
  • Average return per fired signal after costs
  • Turnover, holding time, and drawdown path

Hit rate is not the full story

A binary signal can be right often and still be poor if it fires on tiny opportunities, misses the best ones, or trades too often to survive costs. The central question is not just whether the trigger is correct. It is whether the decisions it causes improve the full strategy.

What belongs on the dashboard

The useful metrics are the ones that separate predictive skill from threshold luck.

  • Base rate and signal frequency
  • Precision, recall, and calibration if the trigger comes from a probability model
  • Average return per fired signal after costs
  • Turnover, holding time, and drawdown path

What often gets missed

Binary strategies are often compared only to cash or to a naive always-trade baseline. A better check is to compare them to the underlying continuous signal. If the smooth score plus simple sizing does better, the binary trigger may just be throwing information away.

What good evaluation sounds like

A serious review sounds less like 'the model is 61 percent accurate' and more like 'the trigger improves net returns in this score range, at this turnover level, with these false-positive costs.' That is the point where it becomes strategy research instead of classifier vanity.