An msnbc.com guide to presidential polls

WASHINGTON - A poll is a small sample of some larger number, an estimate of something about that larger number. For instance, what percentage of people reports that they will cast their ballots for a particular candidate in an election?

A sample reflects the larger number from which it is drawn.

Let’s say you had a perfectly mixed barrel of 1,000 tennis balls, of which 700 are white and 300 orange. You do your sample by scooping up just 50 of those tennis balls.

If your barrel was perfectly mixed, you wouldn’t need to count all 1,000 tennis balls — your sample would tell you that 30 percent of the balls were orange.

People, of course, are far harder to sample.

A tennis ball won’t spontaneously change its color from white to orange, but a would-be voter might suddenly change his or her intention about whether or not to vote, or change his or her preference for a particular candidate.

Sampling
Poll results vary based upon the people being surveyed.

Some pollsters use random-digit telephone dialing of a population in order to ensure that their sample is not skewed to one group.

Others buy lists of phone numbers from vendors.

In some cases, pollsters try to find the people most likely to actually vote. Using a “likely voter screen,” pollsters ask questions such as:
“How likely are you to vote in next Tuesday’s election?”
“Where is your voting location?”
“What precinct are you in?”
“What time will you vote?”

If a respondent doesn’t know where the polling place is, or what time the local polls close, he or she might be tossed out of the sample.

In some cases, pollsters narrow their survey to registered voters, or those who have voted, say, in the last three out of four elections.

But David Paleologos, director of the Political Research Center at Suffolk University in Boston, said this technique can be used only in states where voters are required to be registered by a certain deadline before an election.

Interactive How it works: Voting technology Check out the different ballot methods to make sure your vote is correctly counted. msnbc.com

In states such as New Hampshire, where one can register on the day of the election, screening out Election Day registrants — people who haven’t voted before — would skew the sample.

Polls rely on those being interviewed to truthfully say whether or not they are registered to vote. A person who isn't registered to vote will taint the sample.

But according to Republican pollster Alex Lundry, there may be social pressure to claim to be a registered voter when in fact one isn’t. The likely voter screening questions attempt to account for this and sift out the non-registered.

“If ever there was an election in which black respondents felt a social desirability bias to over-report their registration, this would be it,” Lundry wrote this week on Pollster.com

“A reasonable person would conclude that an unregistered African-American, called to participate in a survey, would feel some sort of pressure (either known or unknown) to say that he or she is indeed registered, and continue with the survey.”

It’s also important to note that sampling is different from poll to poll. For instance, Gallup’s sample of 1000 people is different from NBC’s sample of 1000. The pollsters are interviewing different people. And that can account for some variation.

But statistics gurus would still contend that if the sampling technique is kosher, then each of those national samples should accurately reflect the entire electorate at a given moment in time.

Cell phones
There has also been controversy over the exclusion of cell phone-only voters in polling.

Recent statistics indicate that 14.5 percent of adults live in households with just cell phones — no landlines.

Some pollsters worry that landline-only polls are missing a huge, often younger, demographic, creating a “coverage bias.”

Until recently, pollsters had been reluctant to interview voters by cell phone, due in large part to legal and logistical hurdles.

Federal regulations require that pollsters hand-dial each number. They also must ask a series of questions to determine if those respondents could have been reached on a landline.

Costs for this process are higher — but have recently been undertaken by several large survey organizations.  Groups that have used cell phone users in their national samples or conducted side-by-side tests include Pew Research Center, Gallup, CBS News/New York Times, Time/SRBI, NBC News/Wall Street Journal, ABC News/Washington Post, and the Associated Press/GfK.

Still, these are relatively small tests, and the margins of error for these samples are likely larger than any possible effect.

Following an NBC/Wall Street Journal poll on Sept. 10, First Read included this in their analysis: "The poll included some cell phone surveys (we found no significant difference in cell phone respondents as we have from landline respondents)."

Methodology
Polls can be automated or administered by an actual, live person. Some argue that recorded voice calls compromise random selection — a member of the household isn’t selected to answer the questions. That task goes to the person who answers the phone.

On the other side, automated polling proponents argue that the method allows for more honest answers, since they’re being given to an unresponsive, silent machine.

There’s also a distinction between national polls and smaller, state polls.

In practice, national polls use longer data collection periods and call back phone numbers if no one answers the first time. National pollsters are also more likely to select random respondents to answer the questions rather than simply asking whoever answered the phone.

But, as Election Day draws near, some of these national poll procedures are usually relaxed to accommodate the need for faster data turnaround.

MORE FROM

Section Front

Obama campaign head gets big book deal Officials turn down Franken request Joe the Plumber to become war correspondent Franken lead at 49 with absentees left to count Minn. Senate winner won't be known in 2008 First Read: 'Twas the seventh week of recount... Franken opens first lead in Minn. Senate race Mom of Palin daughter's boyfriend arrested Minn. court weighs rejected absentee ballots Minnesota panel reviews disputed ballots Section Front   Add headlines to your news reader: