I was struck, looking at recent state polling on the Real Clear Politics site, how inconsistent the Quinnipiac polls are with those of other organizations.
-
In Ohio, they show an Obama lead 6-9 points greater than does any other poll.
-
In Florida, they show an Obama lead of 5-9 points greater than does any other poll.
-
In Pennsylvania, they show an Obama lead of 6-14 points greater than does any other poll.
These Quinnipiac polls show, at the very least, a 5 percent differential from ANY and ALL polls done during similar time-frames, and this differential is always to Obama’s advantage.
Note also, that in most cases, if one were to subtract the margin of error from each of Quinnipiac’s numbers, and add the stated margin of errors of the other polls, Quinnipiac would still usually be showing numbers that are either moderately or wildly at variance with all other polling. And again, always to the advantage of Barack Obama.
How is this even possible?
It goes without saying that either Quinnipiac is right or everybody else is wrong. In either case, it means that at least some people are doing questionable polling out there (not everyone can be right within their margins of error with these results) and that there must be some factor or factors being brought into play in polling that ought to be isolated and considered for what it might teach us about polling in general.
In investigating Quinnipiac’s methodology, one thing that jumped out at me immediately was their use of Quinnipiac student interviewers to conduct the polls.
Weighting by party ID, as all polls do, is always something to account for–but why would Quinnipiac be weighting differently in three separate states from all other organizations?
What stands out to me above all else–in regard to Quinnipiac’s differences with other polling organizations–is that their results are based on telephone conversations between voters and 18-22 year olds. The very same demographic, as virtually everyone has come to know, which supports Barack Obama over John McCain by overwhelming margins. This theory I am putting forth assumes that significant numbers of interviewees can identify–over the phone–the age of their interviewers. And that they will respond accordingly.
The so-called “Bradley Effect,” which is not, as is sometimes suggested, so much about racism as the phenomenon of interviewees attempting to conform to the assumed biases of their interviewers, begins to look like a very plausible explanation in the case of Quinnipiac. Again, since the use of those belonging to a very specific and narrow demographic group to conduct interviews is the most obvious way in which Quinnipiac differs from all other polling outfits.
Many pollsters (like Rasmussen) attempt to avoid the potential for this kind of statistical bias through the use of robo-calling, in which interviewees don’t interact with live human beings.
Why lie to a machine?
But to broaden the argument beyond Quinnipiac: if those polled are ever willing to lie (and I believe that the odd results put forth by the Quinnipiac polls plausibly suggest this to be the case) that means that the so-called “Bradley Effect” is real, and under the right conditions it will manifest itself in polling.
So where does this potential for lying stop and where does it end? Does robo-calling eliminate this potential form of statistical bias completely or merely diminish it? To answer that question, we’d have to know just strong the social pressures to identify oneself as an Obama voter are, and how far into the closet some percentage of McCain voters have gone. The cynical response, I suppose, is to say that perhaps they’re so deep in the closet that they’ll pull the lever for Obama on election day!
I have no doubt, for the record, that McCain is behind–in some important places significantly. But is polling really telling the whole story?
I believe that we can take for granted that the candidacy of Obama, the first African-American candidate to head a national presidential ticket, is a unique phenomenon that’s injected any number of factors into the political scene that might skew traditional polling. Some of these factors could benefit Obama. Perhaps some intending to vote Obama lie–because they live among McCain supporters–by claiming they’ll vote for McCain. And more likely than that, perhaps the pollsters have failed to account for a massive and unprecedented surge of first-time voters.
In any event, there is some solid evidence from this current presidential election cycle that suggests that even robo-calling can result in a significant pro-Obama bias.
Here’s an exellent example. Rasmussen predicted, in his final poll in the race, that Barack Obama would defeat Hillary Clinton in New Hampshire by 7% points.
The level of political activity in New Hampshire at the time was extremely high–like it is now in the entire country. New Hampshire is a state which is something like 96% white. The historical nature of Obama’s historical candidacy was trumpeted from the mountaintops. Polled Independents claimed they’d be voting for Obama by a 2-1 margin. Though presumably the Bradley Effect would be a less salient factor in a Democratic primary than in a general election, Barack Obama went on to lose by 2.6% to Hillary Clinton. The robo-calling was off by 9.6%. Currently, as a point of reference, Rasmussen says that McCain is down 10 points in New Hampshire to Barack Obama.
Steve Maley
Neil Stevens
Daniel Horowitz
Interesting Theory
exitsfunnel Saturday, October 4th at 12:01AM EST (link)It’s an interesting theory but I’d be much more likely to believe that it’s the result of their turnout model (a description of which I couldn’t find anywhere on their website) than the Bradley Affect.
-exits
Bradley Effect
RMJ (Diary) Saturday, October 4th at 8:36AM EST (link)You make some good points and I think this is your best one:
I also believe that Sarah Palin brings a number of unique or unusual factors into play.
As you point out, the known and unknown factors cut both ways and we won’t know what the net effect is until late on November 4th.
PA farmer-no doctor but smart!!!
StrongProud Saturday, October 4th at 9:54AM EST (link)While suturing a cut on the hand of a Pennsylvania farmer whose hand had been caught in a gate while working cattle, the doctor struck up a conversation with the old man. Eventually, the topic got around to Obama and his bid for the Presidency. The old farmer said, Well ya know, Obama is a “post turtle”. Not being
familiar with the term, the doctor asked, what is a post turtle? The old farmer said, when your driving down a country road and you come across a fence
post with a turtle balanced on top, that’s a “post turtle”. The old farmer
saw a puzzled look on the doctor’s face,so he continued to explain.
You know he didn’t get there by himself,
he sure as heck doesn’t belong up there,
he doesn’t know what to do while he is up there, and you wonder what kind of an idiot(media) put him there in the first place!!!!!!!!!! Independent for McCain/Palin.
Joke So Old It's New Again
Strelnikov (Diary) Saturday, October 4th at 10:02AM EST (link)For another (Texan) version:
http://www.urbandictionary.com/define.php?term=Post%20Turtle
As of November 4, 2008, the Code Words will be: “Klaatu – Borada – Nikto!”
Corporate Taxes
StrongProud Saturday, October 4th at 11:15AM EST (link)McCain must use “private enterprise 101″
to show Americans that, small business and corporations in America employ
one “hell of a lot” of Americans! If
small business and corporate tax rates are “competitive” in the “world market” (Ireland’s corporate taxes are less than 1/3 of ours) then American business has no incentive to locate abroad, close up shop or lay off Americans because of high operating costs(includes heavy taxes)!!! True, a large percentage of America’s business owners “personal income” is in the upper income tax bracket but remember, business owners bare all the risk and should be rewarded “personally”! BHO’s “big socialist Government plan” will tax the hell out of business owners(he flip-flopped on the issue of taxes now but will certainly raise them, if elected). My point is this, why would we raise taxes to any income level in a stagnant economy!!!Reduce taxes now for all income levels but watch inflation!Independent for McCain/Palin!
robocalls not immune
dingo (Diary) Saturday, October 4th at 1:16PM EST (link)As you show, Robocalls might not be safe from the Bradley effect. Although people are being called by a “robot”, I would think they still might be concerned about appearing anti-black. After all, they know that a polling firm is calling them, and taking their preferences, and even if the whole procedure is claimed to be anonymous, most people would assume that modern technology can track them.
Dingo