# Fumbling the Interpretation: Statistical Models and the Super Bowl

Predictionmachine.com generated a statistical model for the 2013 Super Bowl that reports a 67% probability of the 49ers winning. The probability of this outcome is different than predicting that the 49ers in fact will win. Yet such simplistic, and incorrect, interpretations are common to  Monte Carlo style models (the type of model run by Predictionmachine.com). For instance, CBS Philly, reporting on the model, comments: “This particular computer model has predicted the correct winner of seven of the last nine Super Bowls.”

Yet the Monte Carlo simulations do not predict winners. They merely report the probabilities of possible outcomes. For illustration, it’s possible that a model gives a 50% chance of one team winning and a 50% chance the other team wins. With such an outcome, it is obvious that the model is not predicting a winner.  And it is not predicting a tie.  It is merely assigning probabilities to possible outcomes.

Suppose the Ravens clobber the 49ers this Sunday. Predictionmachine.com’s model could nevertheless be perfectly valid even though it assigns a 67% chance that the 49ers win. This is because such a clobbering is possible and assigned positive probability by the model.

All this is important to remember because people frequently latch onto the average outcome as if it is the predicted outcome. In fact, the actual occurrence of an average outcome could be extremely unlikely. For instance, the average outcome in the Predictionmachine model (as reported by CBS Philly) is as follows:

The 49ers beat the Ravens, 28.6 to 21.3