HeadlinesBriefing favicon HeadlinesBriefing.com

Why You Think Like a Bayesian but Were Taught Like a Frequentist

Towards Data Science •
×

The Schoolroom Distortion Think back to your first high school statistics class. The teacher walks to the blackboard, draws a coin, and asks a seemingly simple question: “What is the probability of flipping heads?” You and everyone else in the room answer instantly: “Fifty percent.” If pressed for an explanation, you’d probably say that if you were to flip that coin an infinite number of times, half of those flips would land on heads. This is Frequentism, and it is the standard operating process of our educational system. It defines probability through the cold, objective lens of repeatable data. In the frequentist world, probability is understood through what would happen if we could repeat the same experiment over and over again. It is a neat, comforting framework designed for a world made of rolling dice, shuffled decks of cards, and endless time. But there is a catch. The moment you step out of the classroom, the laboratory walls crumble. Real life rarely offers us the luxury of infinite trials. You cannot marry someone a thousand times to measure the probability of a happy marriage, nor can a company launch the exact same product campaign on Instagram a million times to test the engagement gain. In the messy arena of human existence, the frequentist definition of probability starts to feel less like a tool and more like a straitjacket.

The Reality: Built to be Bayesian And at this very point is where the grand illusion of our education becomes apparent: while we were trained to think like frequentists on paper, we seem to be naturally inclined to reason in Bayesian-like ways. In the real world, probability isn’t about counting repetitions in the infinite future; it is about quantifying uncertainty in the present. This is the core of Bayesian statistics. Instead of demanding endless data before making a judgment, a Bayesian starts with a Prior, an initial belief based on past experience or intuition. Then, as new evidence arrives, they update that belief to arrive at a Posterior probability. We don’t need a math degree to do this. The human brain often behaves like a Bayesian prediction engine. Our ancestors in the savannah didn’t have the luxury of waiting for a rustling bush to move ninety-nine times to calculate a p-value before running from a predator. They had a powerful prior: “Rustling bush equals danger.” They saw a tiny bit of new data (maybe a flicker of yellow fur) instantly updated their probability, and survived. It is not hard to see why a fast, Bayesian-like way of updating beliefs could have been useful for survival. Of course, none of this means we are flawless statisticians. Decades of work by Kahneman and Tversky showed something paradoxical: when asked to reason about probabilities explicitly, with numbers on paper, humans are notoriously bad. We routinely ignore base rates and get textbook Bayesian problems wrong. But this is exactly the point. We run the Bayesian engine beautifully when we don’t think about it; we just can’t read its dashboard. Our intuition is the posterior; our conscious math is the bug.

The Supermarket and the Waiting Game To see this evolutionary machinery in action, we don't need to fight off tigers. We just need to look at how we navigate ordinary, adult life. Imagine walking into a premium supermarket while traveling in a foreign country. You spot a high-end chocolate bar on a shelf, but there is no price tag. A strict frequentist approach would have a harder time here: you have zero observations for this exact item in this exact store. Theoretically the price could be two euros or t...