How a Hundred Year Old Finding Picks NFL Games As Well As the Experts

In 1906 Sir Francis Galton came across a contest at a fair in which people were guessing the weight of an ox that had been chopped up to eat. The person who produced the closest guess would win the meat and presumably not go hungry for a long time. Galton believed that, for the most part, people were stupid and he could prove this by showing how far off their guesses were. Somewhat ironically, while nobody guessed the weight, Galton found that the average of all 800 guesses was only a few pounds off the 1,198-pound weight of the ox.

We now call what Galton had found the Wisdom of the Crowd, and while it only applies to certain topics, we are better off taking opinions from as many people as possible, rather than just asking one person, even if that one person is an expert. Regis Philbin said when somebody on Who Wants to Be a Millionaire? asked the audience, it was extremely rare that the majority would give the wrong answer. So even while most people in the audience will give the correct answer, we would much rather have the option to ask the whole audience than to ask one random person in the audience.

Predicting the NFL

With this in mind, let’s look at the accuracy of betting lines and their ability of correctly predict the outcome of NFL games. Point spreads exist because they make betting on single games tougher. However, if we are predicting the winner straight up, we can use the point spread as a helpful tool (we’ll get to picking against the spread in a bit).

Remember that the guy setting the line is not making a personal prediction on the game. He wants to choose a number that will evenly divide bettors (which is how he earns his money). He can allow the market to guide him and readjust the line if the bets become too one-sided. The crowd will ultimately dictate the line.

The Data

From 2009-2013, the favorite was victorious in 857 of 1269 picked games, which is a 67.5% success rate (even games were not included). Things fluctuated over the years with the success ranging from a low of 64.4% correct in 2012 to a high of 71.3% the following year.

Compare this to the best picker on ESPN’s Pigskin Pick ‘Em Game in 2013, who predicted the winner in 75% of the games. In other words, he picked just ten more games of the 256 correctly than the spread did. The technique of the winning picker is unknown, but going with the odds on every game means putting in virtually no work. Copy and pasting selections would have tied for the 47th overall rank on ESPN, which is still in the 99.9th percentile.

On the other side of the spectrum, in 2012 the favorite picked 163 games, or 64%, accurately. The top picker on ESPN correctly choose the winner in 188 or 73% of games. But even in a down-year, the line still beat over 500,000 guessers.

Accuracy of picks over the years

Wiser Crowds

Using a crowd to pick a game can change depending on which crowd you go with. Ask a bunch of fifth graders and you will not get the same results as bettors who are putting money on a game. The line differed from the majority’s pick on ESPN in 60 games in 2012 and 2013. The line favorite in those games won 37 to ESPN’s 23. This is too small of a sample to draw any conclusions from, but one possible reason being that ESPN’s users are more likely to make risky picks without money on the line.

Degree of Certainty

While every game has two teams, not all are equally difficult to predict. Favorites in games with a point spread of less than three won just 52% of the time, while teams favored by 11 or 11.5 points won 90% of the time. As the spread increases, we find that the chance that team will win the game steadily increases as well.

For simplicity's sake, games with similar spreads (ie. 9 and 9.5pts) have been combined.
For simplicity’s sake, games with similar spreads (ie 9 and 9.5pts) have been combined.

Picking Against the Spread

Picking a winner is one thing, but Galton’s hunch about people being dumb (we’re talking about beer drinking football fans here, not rocket scientists) must fall apart when they come up against the spread, right? Not exactly.

Picking against the spread is tougher: The guy who won Pigskin Pick ‘Em against the spread last year picked 159 games right compared to the straight winner who got 191. Still the masses guide the betting line, which will shift over the week. ESPN sets their lines on Tuesday, but you don’t have to make your pick until game time, which allows a few more days for the crowd to work their magic. And unlike ESPN, virtually all betting sites do adjust their lines as the week goes on.

If the line increases from Tuesday to Sunday (I usually take the average line from multiple sources, thus increasing the crowd size), even if it’s not by much, it would be wise to bet the team will cover. On the other hand, if an injury leads to a decrease in the crowd’s confidence and a shrinking spread, we would be wise to go with the underdog. It is not complicated (nor is taking advantage of “soft lines” new strategy), but it has been right 52 out of 90 times this season, which is better than 94% of about 100,000 entries on ESPN. If you don’t think a day or two will make much difference, note that it has only worked 44 times on Yahoo! where lines are set on Thursday.

How do the Experts Stack Up?

The remarkable thing about the Wisdom of the Crowd is not that the crowd is better than any given analyst, but that the crowd even comes close. When we step back and consider what exactly the crowd is—in Pigskin Pick ‘Em it is anyone with internet access, in Vegas lines it’s anyone with a few bucks—we would probably think most employees of sports networks would be much better than such a motley crew. looked at predictions made by 13 analysts from ESPN and Sports Illustrated from 2009 to 2012, and found that only two, Jim Trotter and Kevin Seifert, were better than the Vegas odds. In a separate 2012 study, they found that on average 23 analysts from ESPN, CBS, and Yahoo (a mini-crowd of analysts) picked the right winner in two more games (165 to 163) than the odds. Recently they looked at 24 analysts from ESPN, CBS, and Yahoo and found that none of them have picked better than Vegas from 2012 through the first five weeks of the 2014 season. As a group they’re 4% worse on average.

As we saw earlier though, the top finishers in Pigskin Pick ‘Em are often as good or better than the experts, so clearly somebody has figured out how to outsmart the masses, right? This really comes down to how many games you are picking. Somebody will win Pigskin Pick ‘Em with a high total, but unless they can perform at such a high level for multiple years, it’s possible they were just lucky. I could accurately pick every game over the whole season with a coin-flips, but that should not make you want to ask me for advice on who to pick (more likely you’d beat me up and steal my lucky coin). Lots of people have perfect weeks, but most cannot maintain that level for more than one week, let alone 17.

Remember when I said that ESPN and Vegas differed on who would win 60 games over the past two years and Vegas has been right in 62% of those? This in no way guarantees that Vegas will be more accurate every season. In fact, ESPN got 13 of the 22 games right in 2012, but Vegas got 28 of 38 right in 2013. So in a dispute who are you better of going with? Obviously we don’t know who is more accurate this season until it is too late.

So Far in 2014

Through the first six weeks of the 2014 NFL season, the line has picked the right team to win in 60 of 90 games, which is right about where it should be based on the last few seasons. The majority has correctly chosen 61 games in Pigskin Pick ‘Em.

The contest has hundreds of thousands of entries coming from people of all walks of life, with all sorts of levels of knowledge about any given football game. Given the choice between them and someone who covers football for a living, you may be tempted to listen to the later. What we find in the numbers though is that the crowds (on ESPN) are actually as good or better than all 13 of ESPN’s NFL experts, all seven of CBS‘s, both of Yahoo!’s, and all four of Fox Sports’ (and their projection software).

The crowd may not help you win your office pool, but surprisingly its track record has shown that if you put aside your ego and stick with the majority every time, you will finish ahead of almost everyone in the crowd individually.

Author Note: I don’t gamble or claim to know anything about it. The preceding is not intended to help you win money, and I’m not sure it even can.