Look familiar? Here, let me show you the data comparing Romney to Obama (as of today at 8:44 am EST).
Note that Obama's truthfulness has dropped a percentage point from where he was when I first calculated his truthfulness a few days ago. I used my truthfulness simulator to test the hypothesis that Obama has lost credibility. The odds aren't much better than one-to-one that he has lost credibility. The 95% confidence interval for ratio of Obama's truthfulness before to after is between ~0.92 and ~1.11. The probability that Obama lost credibility ~56%. There is even less evidence that Romney's credibility has changed over the last week. The 95% confidence interval for the ratio of Romney's truthfulness before to after is between ~0.73 and ~1.37. The probability that Romney gained credibility is ~51% (basically the toss of a very slightly unfair coin).
If you think the analysis in the previous paragraph is kind of silly, you're kind of right. But I'm just demonstrating another use of my simulator: you can compare an individual report card to that individual's report card at another point in time. Eventually, I will extend the method to allow for the analysis of report cards over several points in time. Actually, I'll use different methods all together. But the point is that you can statistically analysis truthfulness over time, not just over individuals.
But let's get back to the main purpose of this post, which is to compare the presidential candidates' truthfulness to that of their respective parties' national committees. Romney's truthfulness is 0.35. So is the RNC's. Obama's truthfulness is 0.54. The DNC's is just two percentage points higher. Can we draw any distinctions between the truthfulness of the candidates and the truthfulness of their parties' committees? Let's use the simulator to find out. Along the way, we'll also compare the DNC to the RNC.
Obama compared to the DNC
Romney compared to the RNC
The RNC compared to the DNC
In a future post, I will address the concerns than many have raised that Politifact.com data is liberally biased, and incomplete. For now, however, just take this as one piece of evidence among many regarding the comparative truthfulness of the RNC and DNC.
Lastly, I stress that comparing the truthfulness of the RNC to the DNC is not the same comparing the aggregate truthfulness of politicians in each party. To do that, I would have to sample the truthfulness of each individual from the appropriate multinomial distribution, average the sampled truthfulness ratings by party, compare the party average truthfulness ratings, and repeat several thousand times to produce a probability distribution, from which I would derive confidence intervals and test hypotheses. Of course, this analysis is also distinct from a comparative analysis of the truthfulness of the Republican and Democratic National Conventions. There, I would have to sample the truthfulness of each individual speaker's statements during the two conventions, average the sampled truthfulness ratings by party, compare the party average truthfulness ratings, and repeat several thousand times, et cetera.
Anyway, Politifact, I'd love some feedback. Here's to continuing my open and transparent pitch of this method, and my commentary on it. I think it would add a lot of value to your Pulitzer prize winning enterprise, which I've found invaluable over the years.