
How accurate are the presidential pre-election polls? Not very, if you believe some high-profile pundits. But an analysis of pre-election surveys tells a dramatically different story. Polls conducted in the days before a presidential election are remarkably predictive of the outcome. And rather than getting worse, pre-election polls have been getting better, according to historical data collected by the National Council on Public Polls (NCPP). The table below compares the results of different 2004 election polls. Click on the areas outlined in red to learn more about them.

2004 Polls
In 2004, the 16 polls conducted between Oct. 27 and the Nov. 2 election may have been the most accurate since pre-election polling began in 1936. Estimates of George Bush’s winning 2 percentage-point margin in these 16 polls were, on average, just a fraction under 2 percentage points.
Pew Research Center
For example, the final survey conducted by the Pew Research Center for the People & the Press reported that 51% of all likely voters planned to vote for Bush and 48% intended to support Kerry - a 3 percentage-point difference. Pew's 3-point difference was 1-point larger than Bush’s final 2-point margin (50.7% for Bush, 48.3%).
Marist College, GWU Battleground and The Harris Poll
Individual surveys also showed only modest variation. Three polls got Bush’s victory margin exactly right, and another 11 came within 2 percentage-points or less. Even the least accurate polls produced results that were within sampling error of the outcome. Two were within 4 percentage points of the winning margin. The Harris Poll conducted over the internet fell furthest from the mark in 2004. The Harris internet survey found Kerry with 50% of the vote and Bush with 47%, or almost exactly the reverse of the actual outcome.
Huh? Isn’t that a 3-point lead, one point off the actual 2-point winning margin? No…remember that the Harris poll had Kerry in front. To produce a 2-point Bush advantage, the margin would have to change by 5 points in order to move from a 3-point Kerry advantage to a 2-point Bush lead.
Democracy Corps
Democracy Corps., the only partisan polling organization included in the NCPP analysis had Kerry up by 4 percentage points in its final poll. To be fair, the Democracy Corps. result was within sampling error from the eventual outcome—a fact that, in practical terms, offers little protection from untrained journalists aching to predict a winner even on the basis of survey results that show a race is too close to call.
The performance of the polls in 2004 was the rule, not the exception. The last presidential election was at least as accurate as any election since 1936, matching the record of polls conducted before the 1960, 1976 and 2000 elections.
Survey-savvy journalists should keep in mind two important caveats when they report pre-election surveys:
- Polls conducted more than a week before an election should not be interpreted as predicting the outcome.
It is simply too early. Some people who don’t plan to vote end up doing
so based on what they hear or see during the campaign’s final week, or
as a result of final get-out-the-vote drives by the campaigns. Others who
plan to vote decide not to bother. And still others change their preferences.
In 2004, the national exit poll revealed that about one out of every 10
voters made up their mind during the final three days before the election
-- and 5 percent said they didn’t decided until election day.
- Not all polls are created equal.
Even among the most reputable survey organizations, polls conducted earlier
in the campaign are more likely to produce varying horserace results.
That’s because many people have not yet firmly made up their minds about
which candidate to support. Several factors -- including the wording
of questions, the order of those questions and to what extent undecided
voters are encouraged to declare a preference -- can produce relatively
large differences in candidate preference among polls. And some
pollsters simply have more experience doing pre-election polls. Which
polls should you trust? Examine their track record in recent elections.
A good place to start is the NCPP Web site: www.ncpp.org/.