Democratic Underground Latest Greatest Lobby Journals Search Options Help Login

New Method for Flagging Vote Miscount Released

Printer-friendly format Printer-friendly format
Printer-friendly format Email this thread to a friend
Printer-friendly format Bookmark this thread
This topic is archived.
Home » Discuss » Topic Forums » Election Reform Donate to DU
ramblin_dave Donating Member (1000+ posts) Send PM | Profile | Ignore Mon Jan-16-06 04:05 PM
Original message
New Method for Flagging Vote Miscount Released
New Method for Flagging Vote Miscount Released -- Specific Type of Statistical Analysis Can Indicate Vote Count Errors in Past and Future Elections

The National Election Data Archive (NEDA) has developed a new sophisticated statistical method for indicating whether reported vote counts in any particular election race has, or has not, been counted correctly. The new scientific method is being made publicly available for analyzing exit poll data may help restore faith in U.S. democracy. The method will be used to Analyze the 2004 Ohio Presidential Election Data.

January 16, 2006 -- After over a year of research, the National Election Data Archive (NEDA) has developed a new sophisticated statistical method for indicating whether reported vote counts in any particular election race between two candidates have, or have not, been counted correctly. The method is being made publicly available on the Internet "Vote Miscount or Exit Poll Error? New Mathematical Function for Analyzing Exit Poll Discrepancy", is publicly available. at and will enable independent analysts to objectively evaluate the validity of any past or future election results.
More at link
Printer Friendly | Permalink |  | Top
Wilms Donating Member (1000+ posts) Send PM | Profile | Ignore Mon Jan-16-06 04:18 PM
Response to Original message
1. .
Edited on Mon Jan-16-06 04:19 PM by Wilms

Printer Friendly | Permalink |  | Top
FogerRox Donating Member (1000+ posts) Send PM | Profile | Ignore Mon Jan-16-06 09:04 PM
Response to Reply #1
3. I have an extra . . . . . . . .
Printer Friendly | Permalink |  | Top
sunshinekathy Donating Member (177 posts) Send PM | Profile | Ignore Mon Jan-16-06 08:38 PM
Response to Original message
2. FYI, Some slight edits have been made to it today
Edited on Mon Jan-16-06 08:39 PM by sunshinekathy
So, please pick it up again if you picked it up earlier this a.m.

1. Some one reading it noticed a couple of typos in the appendix which derived the formula, and

2. I noticed an error in numbers in the Ohio example 1, and

3. I've been replacing the charts with charts that are formatted to be more easily read, and that is a time-consuming process (I've still got six to go).

Now, if only the availability of this method of analyzing exit poll discrepancies would prompt:

1. the National Election Pool and Edison/Mitofsky to publicly release the data needed for analyzing discrepancies (in time for candidates to use it for wiser decision-making), or

2. some fundraising to be done to conduct public exit polling prior to 2006, which someone like Zogby or Dan Jones or ?? could be hired to help with and a couple of election activists groups I know would be willing to help organize volunteer pollworkers to accomplish.

Printer Friendly | Permalink |  | Top
Febble Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Jan-21-06 10:21 AM
Response to Original message
4. OK, finally got round to reading this thing
Edited on Sat Jan-21-06 11:10 AM by Febble
as it appeared that it might account for the strange inferences drawn in the Baiman Dopp Smoking Gun paper.

What Dopp appears to have done is to derive a formula with which to simulate the patterns of Within Precinct Discrepancy that would occur for a) bias in the poll and b) vote miscount, or combinations of the above, when WPD is plotted against Kerry's vote share.

Which is fine. I did something similar a while back, as I wanted to know the answer.

She then uses her formula to simulate a number of scenarios. Bizarrely she plots these as bar graphs, which causes her problems, because, as in the Baiman Dopp paper, when precincts share a value on the on the x axis, they cannot be plotted. This is why graphical representations of correlations are normally represented as scatterplots, not bar graphs. She solves this problem, however, by taking the mean of two data points when ever they share an X value. If applied to real data (as is done in the Baiman-Dopp paper) this will, of course, invalidate any statistical inference regarding the co-variance of the variables. However, as she doesn't draw any at this point, this is fairly trivial.

She then simulates two scenarios where (it would appear) every precinct has a poll bias of 56:50 or 50:56 respectively. She plots a regression line through a plot of the resulting WPDs, which appears to be flat, although she does not give the value of the regression coefficient. She has extensively elongated the X axis, so it is hard to tell whether there is a slope or not. However, the function can in fact be calculated by algebra, and is given in my paper Edison/Mitofsky Exit Polls 2004: differential non-response or votecount corruption?. It takes the form of an assymmetrical U shape, going, as Kathy rightly observes, to zero at both ends of the X axis, but because it is assymmetrical, a linear regression line through the plot will tend to have a positive value. If sampling error is included (as it is in this simulation) this will tend to flatten the slope. It will, however be a real effect, and will be detectable given enough iterations.

She then demonstrates that a scenario in which error arises from vote miscounts will produce a marked positive slope. Here, I agree with her, and in fact Josh Mitteldorf demonstrated this some time ago, and I produced a model that also demonstrated it. I sent this to Kathy, and in fact it is still, I believe, dowloadable on her website here. The effect is more pronounced if you use, as I did, ln(alpha) as your measure of bias rather than WPD, but it will be true of WPD as well. The problem with using WPD is that because WPD will produce also produce a slight positive slope in the presence of polling bias alone, it makes the effects harder to disambiguate. But I will agree with Kathy that fraud will tend to produce a more marked positive correlation with voteshare than polling bias. Here we do indeed have a potential "fingerprint".

However, she then goes on to plot her simulated WPDs against not vote share, but against exit poll share. She finds that in the "polling bias" scenario, that she gets a "slight non-zero slope", although she doesn't explain it. However, it is readily explained by the fact that her simulation formula includes an error term for sampling error. As this error term affects both the values on the y axis (WPD) and the x axis (exit poll share), there will, inevitably, be a non-zero slope. The two variables are mathematically correlated.

She then repeats this for the "vote-miscount" scenario, and again finds a negative slope, for exactly the same reason***.

She then states:

The signature for WPD caused by vote miscounts seems to be a negative slope trend line whenever WPD is plotted by exit poll share irregardless of which candidate vote miscounts benefits.

What in fact Kathy has demonstrated is that the more variance there is in WPD, whether caused by vote miscounts or polling bias, the more WPD will be correlated with exit poll share. This is simply because the "error" term is common to both axes. It will be greater for non-uniform fraud than for uniform bias; similarly it will be greater for non-uniform bias than for uniform fraud.

In other words all the slope tells you is the amount of variance in WPD. Not what causes it. There is no signature in that slope for anything other than variance.

It remains worth investigating whether redshift in a suspect election is correlated with vote-share. For example: is Bush's vote share as high as it is because fraud put it there? If so, WPD is a poor measure to use, because of its built-in correlation with vote-share. It is not easy to find a measure in which this is not a problem, although I think that a measure developed by Mark Lindeman and myself, and dubbed "tau prime" is fairly sound*. As far as I can tell, however, even using WPD, there is no significant correlation between vote share and WPD in Ohio. Moreover, even after controlling for variance in Bush's vote share predicted by his vote-share in 2000**, as was done by ESI, and which ought to increase the statistical power, there was apparently no significant correlation.

The remainder of the paper seems to involve various scenarios in which some hypothetical "uniform" bias is subtracted from all polls. As no-one has postulated "uniform" bias (what conceivable factor could produce such a thing? In any case we know from the E-M report that WPE was not "uniform" - it covaried with a number of important factors, such as interviewing rate and the distance the interviewer stood from the precinct) this must remain a theoretical exercise only - and in any case, the magnitude of the bias cannot be known, a priori. It is why we bother to investigate in the first place. Finally she presents a strategy for paper ballot audits which is fine and useful, and is given in more detail in another of her papers, How Can Independent Paper Audits Detect and Correct Vote Miscounts?.

In summary: Kathy's conclusions as to the patterns that disambiguate fraud and polling bias are largely invalid; the one valid pattern she notes is not best detected by WPD, and in fact was suggested by Josh Mitteldorf months ago, and indeed tested on the national dataset by Mitofsky, using my proposed measure, and no significant correlation was found.

I do not rule out fraud in the 2004 election; I do not even rule out the possibility that some forms of vote corruption may have contributed to the exit poll discrepancy. But I do not consider that this paper offers any valid way of distinguishing vote corruption from polling bias, and is thus an inappropriate tool with which to draw "virtually irrefutable" conclusions regarding vote-corruption in Ohio. And, of course, I also reject all the author's allegations concerning my honesty. This is an honest critique.

Elizabeth Liddle

* A section of the paper is also devoted to attempting to demonstrate that the measures devised by myself and Mark Lindeman: "distort the effects of random sampling error, and are not useful for analyzing exit poll discrepancy data." I have addressed this critique elsewhere, but briefly: the measure we propose does not distort the effects of sampling error, but reflects it. In contrast, WPD is a distorted measure of the underlying factors that create bias, whether vote miscount of polling bias, giving larger values for a given propensity to bias in the centre of the voteshare distribution than at the extremes.

**Dopp, of course, claims that this procedure is illogical. It is, nonetheless, the basis of all multivariate statistical analysis. If Dopp is correct, her paper means the end of Statistical Analysis As We Know It.

***(on edit) On closure inspection of the various scenarios, there would appear to be a second reason for Dopp's fraud "signature" pattern: she postulates a uniform percentage shift in Kerry's votes to Bush. Clearly, a given percentage of 20% of the votes will result in a smaller WPD than the same percentage of 80% of the votes, so in this scenario, a correlation is built into the model - it models a scenario in which more votes are switched in higher Kerry precincts than in high Bush precincts. This, ironically, cancels out the tendency for WPD to be greater in high Bush precincts, and reverses the expected positive correlation between WPD and Kerry's vote share, whereby WPD will be more negative at the Bush end of the spectrum. In this "miscount" scenario, it would appear that the "signature" of fraud is a NEGATIVE correlation between WPD and Kerry's vote share - with more negative WPD at the high Kerry end of the spectrum, the opposite pattern to that Dopp claims is the pattern in Ohio, and which Baiman-Dopp claim is "irrefutable evidence of vote miscounts".

I give up.
Printer Friendly | Permalink |  | Top
Febble Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Jan-21-06 11:53 AM
Response to Reply #4
5. Correction
I do appear to have misread Dopp's plots. I apologise.

It seems that her model of vote miscounts does not predict a positive correlation between WPD and Kerry's vote share, but a negative one. I am used to reading Bush's vote share on the X axis.

This, however, makes her use of the Ohio plot (page 8) as an example somewhat odd, as it clearly shows a positive slope. I do not believe this slope is statistically significant, although it does look impressive on this particular plot. But if it IS significant, it slopes in the opposite direction to that predicted by Dopp's fraud model.

Certainly, other fraud scenarios are possible, and some of these predict a positive correlation between Kerry's vote share and WPD. Ironically, however, the one proposed by Dopp does not.

Any dataset that contains variance in WPD will, however, produce a negative correlation between WPD and Kerry's exit poll share, for reasons given above.
Printer Friendly | Permalink |  | Top
OnTheOtherHand Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Jan-21-06 12:43 PM
Response to Reply #5
6. look at the top of p. 13
If that plot (at left) strikes you as similar to the Ohio data, then hey, it's the smoking gun!

It doesn't strike me as especially similar, but then, I am a naysayer. Surely any reasonable observer will agree that if a single run with sampling error, 25% fraud to Bush in 40% of precincts, and response rate bias favoring Bush elicits a positive slope, then a positive slope demonstrates sampling error, 25% fraud to Bush in 40% of precincts, and response rate bias favoring Bush. Right? In symbolic logic, that would be "Some A implies B, therefore all B implies A," the well-known Dopp Theorem.
Printer Friendly | Permalink |  | Top
Febble Donating Member (1000+ posts) Send PM | Profile | Ignore Sat Jan-21-06 01:07 PM
Response to Reply #6
7. Thanks.
Edited on Sat Jan-21-06 01:14 PM by Febble
I certainly made the mistake of assuming that this paper would provide support for the Smoking Gun paper, rather than undermine it.

So - the exit poll data patterns points to fraud in Ohio, as long as we postulate that the exit polls were biased in favour of....Bush?


You know, I thought I'd caught a couple of relatively simple errors on this paper. I mean averaging the precincts with the same values on one axis is pretty crass, but as there aren't any inferential statistics tested, I'd give it a pass, just re-submit with proper plots. And the plot-with-exit-poll-share gave me a double take until a moment's reflection told me it was nuts. I can see its intuitive appeal to an exit poll true believer, but even Kathy believes that polls have variance due to sampling error.

But it didn't actually occur to me that the fraud mechanism postulated would predict the opposite of the claimed pattern in Ohio - and that you'd have to postulate pro-Bush bias in the poll to demonstrate that it was consistent with vote miscount there.

Hey - if we postulate massive pro-Bush bias in the poll we could infer a landslide for Kerry!

Oh wait... TIA's done that already....

Lidlindians rock!

(edited for typo)
Printer Friendly | Permalink |  | Top
DU AdBot (1000+ posts) Click to send private message to this author Click to view 
this author's profile Click to add 
this author to your buddy list Click to add 
this author to your Ignore list Fri May 24th 2024, 05:58 AM
Response to Original message
Advertisements [?]

Home » Discuss » Topic Forums » Election Reform Donate to DU

Powered by DCForum+ Version 1.1 Copyright 1997-2002
Software has been extensively modified by the DU administrators

Important Notices: By participating on this discussion board, visitors agree to abide by the rules outlined on our Rules page. Messages posted on the Democratic Underground Discussion Forums are the opinions of the individuals who post them, and do not necessarily represent the opinions of Democratic Underground, LLC.

Home  |  Discussion Forums  |  Journals |  Store  |  Donate

About DU  |  Contact Us  |  Privacy Policy

Got a message for Democratic Underground? Click here to send us a message.

© 2001 - 2011 Democratic Underground, LLC