Questions for you:
- If you had to put actual money on your stated beliefs about future outcomes (business forecasts, project timelines, strategic priorities), would your betting behaviour match your stated confidence levels?
- When you say you “strongly believe” something, have you ever tested that belief by examining what risks you’d actually take based on it? Online prediction markets should be entered carefully, if at all – but just tracking your own estimations over time can be revealing.
- What preferences do you claim to have that you’ve never actually tested through choices involving real trade-offs or uncertainty?
- If someone offered you gambles based on your stated probabilities (“you said 70% likely, so bet at 7:3 odds”), where would you discover gaps between your words and your actual convictions?
Organisational applications:
Decision-making calibration: Test whether leadership’s stated confidence matches their willingness to commit resources. If executives claim 80% confidence in a strategy but won’t allocate budget accordingly, their revealed probability is lower. Use betting frameworks in scenario planning: “If you believe this has a 60% chance, would you take this bet?” This forces honest assessment of actual beliefs versus aspirational statements.
Preference elicitation for product development: Don’t ask customers what they prefer – offer them choices with trade-offs. Ramsey’s insight applies: stated preferences often differ from revealed preferences. Use conjoint analysis, A/B testing, or actual purchase behaviour rather than surveys. Many users of online services say they value privacy but choose convenient services with poor privacy practices, revealing true preferences through their choices.
Risk assessment verification: When teams provide probability estimates for project risks, test calibration by examining historical accuracy. If someone consistently says “70% likely” for events that occur 40% of the time, their stated beliefs don’t match reality. Implement calibrated forecasting where people track their probability statements against outcomes, improving accuracy over time.
Resource allocation audits: Compare stated priorities with actual resource allocation. If leadership says customer experience is the top priority but allocates minimal budget there, this reveals that their actual preferences differ from the stated ones. Ramsey’s framework: actions under uncertainty reveal true values better than declarations. Use this to examine what your organisation, and other organisations, are actually focused on, rather than what they say matters.
Further reading
Frank Ramsey and decision theory
- Truth and Probability by Frank Ramsey (essay) – the original 1926 work where Ramsey argues that beliefs should be understood as betting behaviour and introduces indifference points as a method for measuring subjective probability and preference intensity, foundational text in decision theory.
- The Foundations of Statistics by Leonard Savage – develops Ramsey’s ideas into comprehensive framework for decision-making under uncertainty, demonstrating how revealed preferences through choices expose gaps between stated beliefs and actual convictions.
- Decision Theory: Principles and Approaches by Giovanni Parmigiani and Lurdes Inoue – modern treatment of decision theory including discussion of how gambling frameworks reveal true beliefs and preferences, with applications across medicine, policy, and business.
Revealed preferences and stated preferences
- Thinking, Fast and Slow by Daniel Kahneman – demonstrates systematic violations of expected utility theory showing how people’s actual choices under uncertainty differ from their stated preferences and beliefs, validating Ramsey’s insight that behaviour reveals truth better than declarations.
- Nudge by Richard Thaler and Cass Sunstein – explores how choice architecture exploits gaps between stated preferences and actual behaviour, showing that revealed preferences through actions often contradict what people claim to want.
- The Signal and the Noise by Nate Silver – examines forecasting and probability estimation across domains, demonstrating how stated confidence levels often fail to match actual accuracy, supporting Ramsey’s argument that betting behaviour exposes true beliefs.
Calibration and forecasting
- Superforecasting by Philip E. Tetlock and Dan Gardner – demonstrates that tracking stated probabilities against outcomes reveals massive gaps between claimed confidence and actual accuracy, with practical methods for calibration improvement through disciplined betting-style thinking.
- Expert Political Judgment by Philip E. Tetlock – shows experts’ stated confidence in predictions systematically exceeds accuracy, validating Ramsey’s insight that verbal confidence claims differ from betting behaviour, with implications for decision-making in uncertainty.
- How to Measure Anything by Douglas W. Hubbard – practical guide to calibrated probability estimation showing how to test whether stated confidence matches reality, with methods for improving decision-making through disciplined quantification of uncertainty.
Interactive exhibit
Try the Ramsey Preference Test for yourself… https://experiments.randomthebook.com/teacoffee/
About the image
A cup of coffee from my 2023 experiment 100 Coffees.
Photo montage and photo by Matt Ballantine, 2026
