Sat Nov 24, 2012, 09:30 AM
Omaha Steve (35,849 posts)
Is Gallup’s place atop poll world slipping?
Source: Omaha World Herald
By Matthew Hansen On Oct. 21, Gallup released a national poll that dropped like a neutron bomb: Mitt Romney had a whopping 7-point lead over President Barack Obama, according to the much-respected polling company whose operational headquarters is in Omaha. Sixteen days later — on Election Night — that presidential bombshell looked very much like a dud. Obama coasted to a second term and ended up winning by more than three percentage points. Now Gallup is taking incoming fire from both independent experts and the Obama campaign for what they see as the company’s errant presidential polling. The criticism comes during a postelection reckoning inside Gallup, as its East Coast pollsters and Omaha statisticians grapple with a crucial question. What, if anything, went wrong? FULL story at link. Read more: http://www.omaha.com/article/20121124/NEWS/711249922
|
40 replies, 4388 views
| Author | Time | Post | |
| Omaha Steve | Nov 2012 | OP | |
| thucythucy | Nov 2012 | #1 | |
| Andy Stanton | Nov 2012 | #2 | |
| The Wizard | Nov 2012 | #3 | |
| PatrynXX | Nov 2012 | #20 | |
| Mass | Nov 2012 | #4 | |
| R. Daneel Olivaw | Nov 2012 | #23 | |
| ProudProgressiveNow | Nov 2012 | #33 | |
| Third Doctor | Nov 2012 | #5 | |
| Chemisse | Nov 2012 | #6 | |
| heaven05 | Nov 2012 | #7 | |
| Walk away | Nov 2012 | #8 | |
| Iliyah | Nov 2012 | #9 | |
| Dakota Flint | Nov 2012 | #10 | |
| movonne | Nov 2012 | #12 | |
| mrdmk | Nov 2012 | #13 | |
| aaaaaa5a | Nov 2012 | #19 | |
| Downtown Hound | Nov 2012 | #28 | |
| ProudProgressiveNow | Nov 2012 | #34 | |
| anokaflash | Nov 2012 | #11 | |
| melody | Nov 2012 | #14 | |
| BumRushDaShow | Nov 2012 | #15 | |
| aaaaaa5a | Nov 2012 | #16 | |
| Downtown Hound | Nov 2012 | #29 | |
| John2 | Nov 2012 | #31 | |
| ProudProgressiveNow | Nov 2012 | #35 | |
| Wolf Frankula | Nov 2012 | #17 | |
| Blanks | Nov 2012 | #18 | |
| unc70 | Nov 2012 | #21 | |
| closeupready | Nov 2012 | #22 | |
| Kahuna | Nov 2012 | #24 | |
| sarcasmo | Nov 2012 | #25 | |
| SCVDem | Nov 2012 | #26 | |
| hrmjustin | Nov 2012 | #27 | |
| Iggy | Nov 2012 | #30 | |
| Midwestern Democrat | Nov 2012 | #32 | |
| David__77 | Nov 2012 | #36 | |
| on point | Nov 2012 | #37 | |
| Ken Burch | Nov 2012 | #38 | |
| defacto7 | Nov 2012 | #39 | |
| tclambert | Nov 2012 | #40 |
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 09:33 AM
thucythucy (1,239 posts)
1. Well, what do the polls say
|
about this?
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 09:37 AM
Andy Stanton (262 posts)
2. Unskewed polls?
|
Buying into the right wing fictionalized universe, no doubt. A strong majority of the poll responders couldn't possibly be self-identified Democrats could they? Time to "unskew" the results.
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 09:44 AM
The Wizard (7,019 posts)
3. Polling is as reliable as
|
the language used in the questions asked.
|
Response to The Wizard (Reply #3)
Sat Nov 24, 2012, 12:36 PM
PatrynXX (2,566 posts)
20. don't know ask Nate Silver
|
He's smarter than anyone on this site. I'm not someone who did well in math. I'd assume Pollsters would be good at math but looks like their margin of error is +- 20 points
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 09:47 AM
Mass (24,634 posts)
4. Gallup has had terrible results election after election for the last 10 years. Good to see the media
|
started to notice, but it is not new.
|
Response to Mass (Reply #4)
Sat Nov 24, 2012, 12:47 PM
R. Daneel Olivaw (2,928 posts)
23. What other numbers are the fudging to sway public opinion then?
|
If they could be so off on the Presidential election then what other races and topics could they be wrong about as well? |
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 09:50 AM
Third Doctor (1,025 posts)
5. Gallup's representation is in the gutter and has been for a while.
|
I wondered why the news shows stubbornly kept using them. Money changed hands no doubt.
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 10:01 AM
Chemisse (18,416 posts)
6. I hope Gallup loses credibility over this - and other pollsters will see if they play politics
|
with their polls, the same thing will happen to them.
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 10:31 AM
heaven05 (2,372 posts)
7. slipping?
|
done slipped, badly.
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 10:36 AM
Walk away (4,597 posts)
8. Gallop Poll... from now on reffered to as The Notoriously Unreliable Gallop Poll.
|
If a news agency uses Gallop's polling data in the future it should be with a caveat.
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 10:42 AM
Iliyah (2,359 posts)
9. Pew was no better
|
I read the Pew poll when it came out with Mittens trouncing Obama and either tying with women or women surpassed themselves and was voting for Mittens, et al., What a total bullshit polling. Gallup was a joke and got crap poured all over them. Corporate media polling at its finest. But the kicker, Mittens and the gop establishment truly believed in their alternate reality really thought they were going to win. They ignored the minorities and was truly hoping the voter suppression, purging and trying to stop early voting would allow their idiot candidate to waltz in. I believe the goppers also had their secretary of states on notice of basically stealing the swing states if it were very close and thats why Pres O's campaign needed to win fairly high %.
It was a damn shame that these GOPpers always talk about patriotism, freedom and being American and they did the total opposite. |
Response to Iliyah (Reply #9)
Sat Nov 24, 2012, 10:54 AM
Dakota Flint (68 posts)
10. Exactly
|
Great summary!
|
Response to Iliyah (Reply #9)
Sat Nov 24, 2012, 11:08 AM
movonne (9,467 posts)
12. Pew is a good name for them...
Response to Iliyah (Reply #9)
Sat Nov 24, 2012, 11:15 AM
mrdmk (2,270 posts)
13. Polling by Gallup is not their main business, bringing a new product to the market?
|
Gallup be your friend. They are a business leader in that field.
Just like the CDO's of Wall Street, how much B.S. is Gallup willing to fan to make American Business look good? Now there collective creditability is in question! Too Bad, sucks to be them... |
Response to Iliyah (Reply #9)
Sat Nov 24, 2012, 12:29 PM
aaaaaa5a (3,701 posts)
19. If folks want an accurate account of what is going on... they should just come here.
|
Going to the Gallup and increasingly PEW site is a waste to time. |
Response to Iliyah (Reply #9)
Sat Nov 24, 2012, 01:35 PM
Downtown Hound (8,211 posts)
28. Pew's final poll for the election had Obama winning by 3
|
Which was almost right on.
|
Response to Iliyah (Reply #9)
Sat Nov 24, 2012, 05:57 PM
ProudProgressiveNow (3,239 posts)
34. +1000 nt
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 11:03 AM
anokaflash (40 posts)
11. SNL Comment
|
As said on Saturday Night Live, all the Gallup poll showed was Mitt had the Old White People with Landlines Demo all wrapped up! LOL
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 11:40 AM
melody (12,123 posts)
14. The same thing that happened to Dennis Miller -- they sold out for a price
|
Sad, but true.
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 11:58 AM
BumRushDaShow (11,956 posts)
15. To Gallup: I hope you fail
|
That's what Gallup's buddy Rash Limpballs wished for regarding the President. Karma's a bitch.
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 12:27 PM
aaaaaa5a (3,701 posts)
16. Why is the media so late to the story.
|
I'm an average Joe. I along with many people on this board were touting how far off Gallup's tracking and approval ratings were back in May and June! And no, not because we were Obama supporters, but because it was very apparent their demographics and crosstabs didn't add up. In fact many said their registered voter model was a far omore accurate than their ridiculous likely voter model. And like almost every other piece of analysis here and at DK, that turned out to be accurate too! Why are some people on this board so much smarter than the folks who are suppose to be experts and who actually do this for a living? Its actually scary that the "so called experts" are so bad at their jobs and can be routinely schooled by political internet forum nerds this often. |
Response to aaaaaa5a (Reply #16)
Sat Nov 24, 2012, 01:37 PM
Downtown Hound (8,211 posts)
29. People were bashing Gallup as far back as 2004
|
Moveon actually ran a piece back then in I think The New York Times showing how Gallup consistently oversampled Republicans in their polls.
Once again, this is old news...to everybody except the lame brains in the corporate media. |
Response to aaaaaa5a (Reply #16)
Sat Nov 24, 2012, 03:08 PM
John2 (1,747 posts)
31. Their
|
Last edited Sat Nov 24, 2012, 03:11 PM USA/ET - Edit history (1) final registered model, actually showed Obama winning by 3 percentage points. The Rasmussen Poll shouldn't be left out either. When all the Polls changed to likely voter models, they were over doing white voters and older voters. A lot of these came from the South too, but if you look at population, the Northeast and West have higher populations.
The midterm elections are not a good parameter to base your model on either because they tend to be low turnouts. The model should have been the last general election which was 2008. Demographics were also very important, because it has changed since 2008. There was also a lot of new Pollsters, mostly Republican, popping up in this cycle, that were anti Obama. Remember the one Republican Pollster, that claimed North Carolina was a done deal for Romney. They claimed the same about Virginia and Florida. That was never the case. Pew was also pressured by the Republicans to alter their methods, more favorable to Romney. I personally never thought it was close and also thought Obama had a chance to sweep all the swing states, including North Carolina. It is still a mystery to me though why he only got 2,178,000 votes out of 2,872,000 Democrats on North Carolina's rolls? I would like to know why so many didn't vote, just like 2008. If the Democrats could research that problem, they would have a much easier time winning the state. Some of those counties are not turning out or the registration numbers are way off. |
Response to John2 (Reply #31)
Sat Nov 24, 2012, 05:58 PM
ProudProgressiveNow (3,239 posts)
35. +1 nt
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 12:28 PM
Wolf Frankula (344 posts)
17. I used to work in polling and market research
|
All polls and surveys, except for the simple A,B,C, preference poll are written to get a desired result. Every goddamn one, without exception. And even preference polls have a built in bias, the order of the options.
Also refusal and non-contact rates have soared. A lot of firms have gone out of business, because their traditional method is failing. A sizable number of people don't have land lines, use caller identification to screen out these type of calls, or are simply not available in the 3-9pm traditional calling time. Wolf |
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 12:29 PM
Blanks (1,351 posts)
18. It used to tell the story of how Gallup came into being...
|
On their website. Every presidential election had been correctly predicted by a periodical (I forget it's name).
They predicted FDRs loss at one point and as a result of small representative sampling; Gallup was able to accurately predict the winner. The same thing has happened to them now. Their sample is not a representative cross-section of all voters because so many have cell phones. If all you sample are land lines; in this day and age you won't get a representative sample. |
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 12:43 PM
unc70 (2,322 posts)
21. This might be why polls were off
|
The "random" sample of telephone numbers for most polls come from a company with close ties to Romney and Bain.
http://www.democraticunderground.com/10021686160 I made this discovery myself before the election, but few people noticed. It needs a good DU investigation. |
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 12:46 PM
closeupready (19,477 posts)
22. IMO, Gallup has been unreliable for quite a long time.
|
Obviously, right-wing journalists in their right-wing echo chamber were shocked to see their results proved to be so wrong.
People who live in the real world and work for a living, however, saw this as par for the course compared to other recent poll results published. |
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 01:11 PM
Kahuna (26,403 posts)
24. They tried to be too cute by half with their LV model. I always discounted that
|
in favor of their registered voter results which were more in line with other polling.
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 01:26 PM
sarcasmo (13,550 posts)
25. Nate Sliver made Gallup pointless.
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 01:28 PM
SCVDem (886 posts)
26. Landlines?
|
Didn't they go away with Blockbuster?
Yeah, I watch South Park. |
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 01:30 PM
hrmjustin (9,198 posts)
27. They have been knocked off their high horse years ago.
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 01:37 PM
Iggy (1,418 posts)
30. WHO Said They Are at the Top of the Heap?
|
n/t
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 03:23 PM
Midwestern Democrat (274 posts)
32. Gallup already has fallen off its throne - it's still the most famous name in polling but they've
|
reached a point where they're basically on probation - in the next election cycle nobody will believe their poll results without confirmation from another respected pollster.
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 07:14 PM
David__77 (14,120 posts)
36. There's sampling error even if the model is perfect.
|
You have a confidence interval at a given level of statistical significance, like +/-6% at a 90% level of confidence. Here, ten percent of the time, you will be further than 6% in error. Maybe they should obtain much larger samples to whittle away the sampling error. It can't be THAT expensive to do so. I think 10,000+ would be required in a country like ours.
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 10:14 PM
on point (1,002 posts)
37. When ideology overrules science you are drifting into delusion
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 11:10 PM
Ken Burch (31,235 posts)
38. The greasy poll can't climb to the top.
|
Last edited Sat Nov 24, 2012, 11:51 PM USA/ET - Edit history (1) n/t.
|
Response to Omaha Steve (Original post)
Sat Nov 24, 2012, 11:56 PM
defacto7 (3,346 posts)
39. We need to watch carefully.
|
Last edited Sat Nov 24, 2012, 11:58 PM USA/ET - Edit history (1) Everything that we've become accustomed to over the years, every sacred cow, the trusted services and institutions are coming down. Times are changing and we need to be watchful for reality. The Republicans have been wearing blinders for too long. We as left wingers have been lucky enough to be aware and didn't flinch when we were laughed at for keeping out eyes on reality, not to be swayed by the cloud of myth surrounding politics or world affairs.
Trust no institution beyond what can be verified. Trust no great power or figurehead that does not balance with reality or the will of the people. Question everything!!! |
Response to Omaha Steve (Original post)
Sun Nov 25, 2012, 05:26 PM
tclambert (5,536 posts)
40. Well, let's see . . .
|
Is it an online poll? Do you poll using landline phones or cell phones or both? How do you find peoples' phone numbers? do you poll registered voters or only likely voters? How do you define likely voters? Do they identify themselves as one or the other? Do you multiply raw results by any factors to unskew the selection bias in your sample of respondents? And what about all those people (like me) who refuse to waste time talking to pollsters?
Man, it's a miracle they ever get close to the right results. |

