Inflated Clinton Poll Theory: The First Field Test [View All]

[skipos]

(Some of you may know that I am working on the Polling Generally Indicates That Hillary Is Not As Strong Of A General Election Candidate As Edwards And Obama Theory. Actually, a quick look at most scientific polling sites supports my theory pretty well. Regardless, this is from Mydd.com and is NOT my theory. Thanks, Skipos)

Inflated Clinton Poll Theory: The First Field Test

by Chris Bowers, Fri May 18, 2007 at 03:50:41 PM EST

Are most live-interviewer, national polls inflating Hillary Clinton's national poll advantage? For two weeks in April, I spent a lot of time trying to answer that question through a series of posts on MyDD that I referred to as the Inflated Clinton Poll Theory. Even though, at the end of the series, I concluded that there was no clear evidence to support the theory, there was no official test of the theory at that time and there were still reasons to think that there might be serious problems with national Democratic nomination preference polls. For one thing, the number of households shifting to wireless only continues to rise, which poses a real danger to traditional, live-interviewer telephone polls. Also, that Rasmussen Reports, which has proven to be an accurate polling firm over the past few years and which employs an automated, IVR polling technique, repeatedly shows different results from more traditional methods, and as such continues to raise eyebrows. Third, all national polls on Democratic primary preferences, no matter who those polls favor, are including an extremely wide net of Democrats and Democratic-leaning independents in their samples that is unrepresentative of the generally narrow Democratic primary and caucus electorate. Finally, there remains the possibility that live-interviewer telephone polls might create a sort of social pressure that alters results. Do people tell machines different things about their political preference than they tell live humans?

Taken together, do all of these concerns inflate Clinton's national poll lead? For over a month, I have sought out a polling firm that would test this theory. In their latest poll, Cook / RT strategies conducted just such a test, and the results are quite interesting. In fact, they support the Inflated Clinton Poll Theory. The following passage from a memo produced by Thomas Riehle, which I just received over email:

Lots of experiments will take place in 2007 testing new methodologies to see if they can meet or exceed the standards for accuracy of the tried-and-true live interviewer methodology using alternative polling methodologies. One important test will aim to determine whether the internal breakdowns of alternative methodologies yield similar results and similar conclusions to what we learn from live interviewer polls. RT Strategies, which conducts live interviewer polls for Cook Political Report, cooperated with a leading online polling firm, YouGov America (formerly Polimetrix) to investigate.

YouGov America is the best choice for an online pollster with whom to compare results, because all "online polls" are not the same. YouGov America employs a sophisticated sampling and respondent-matching methodology, in concert with superior panel recruitment, to make it the only online poll that can deliver a true, randomly selected sample without resorting to the crushing expense of recruiting and then providing internet access to communities that are otherwise under-represented online, or by employing the statistical gymnastics of "propensity weighting" to mask that under-representation.

Two recent Cook Political Report/RT Strategies polls were combined to yield a healthy sample size of 790 Democrats and Democratic leaners from live interviewer polls conducted April 27-29 and May 11-13. During that same time span, and using a questionnaire identical to the questionnaire used in the Cook Political Report / RT Strategies polls, YouGov America interviewed a random selection of its online panelists that included 750 Democrats and Democratic leaners. The results follow.

* Hillary Clinton scores less well online than she does in live interviewer polling. Overall, Clinton gets 32% in the combined Cook Political Report/RT Strategies polls, just 24% in the YouGov America online poll. The big differences: Among Baby-boomers and in the West, the online panelists were less likely than respondents to a live interviewer poll to make Clinton their first choice for the nomination. Hispanics online are much less likely than respondents on the phone to support Clinton.

* Obama's scores are very similar online to what he scores in live interviewer polls. Overall, Obama gets 24% with live interviewers, 23% online. Obama tends to score as well or better online among younger voters, much worse among the oldest voters, and not as well online among African-Americans as he does under the live interviewer methodology.

More...
http://mydd.com/story/2007/5/18/153019/987