The Roundup: Abortion Edition

Todd Akin is taking the GOP down with him.

Yes, Plenty of Republicans Want to Ban All Abortions, Full Stop
The Todd Akin incident reminds us that this election could easily decide the future of a woman's right to choose. Multiple states have attempted to pass bills that could effectively ban all abortions if Roe v Wade was overturned (thanks to a conservative appointee from a Romney administration and the inevitable GOP controlled senate).

PolitiFact: Women's group says Paul Ryan would "outlaw in vitro fertilization”

"UltraViolet has a point that the bill Ryan backed could significantly alter the way in vitro fertilization is practiced. However, the group exaggerates when it says the bill in question would "outlaw in vitro fertilization." The bill doesn ’t outlaw the procedure directly -- whatever impact it has would likely require action by states, which many states may be unwilling to undertake. And while the bill likely outlaws specific practices that have historically been considered important for practicing in vitro fertilization, it would not ban the procedure itself."

FactCheck: Another Abortion Falsehood from Obama’s ‘Truth Team’
Some clarification on the 2012 GOP platform on abortion:

"It’s true that Romney has voiced support for the 2008 platform’s call for an unspecified “Human Life Amendment” to the Constitution, and the language approved by the party’s platfor m committee for 2012 is identical. But that’s a far cry from advocating an abortion ban that would apply in cases of rape or incest."

And it turns out that we have been to careless over speculation that these Human Life Amendments will ban abortions in the cases of rape and incest:

"As we’ve said before, there have been numerous versions of human life amendments proposed over the years, some of which include exceptions for rape and incest and some of which don’t. For details, see our July 31 item, “Falsifying Romney’s Abortion Stance, Again.” Most of these amendments didn’t get out of committee."

However, the speculation is not entirely unfounded:

"Furthermore, Romney’s chosen running mate, Paul Ryan, opposes exceptions for rape or incest. And it would be accurate to say that the GOP platform calls for a constitutional amendment that would leave states free to adopt abortion bans without exceptions."

So Red States would be screwed still....

However, as Suzy Khimm of The Washington Post finds, it may also be the case that none of this matters.

"But do party platforms even matter? Much of the political science research suggests not — at least when it comes to the candidates’ own views and actions. “The nominee is not necessarily constrained by the formal platform. They can agree with whatever bits and pieces and ignore the rest,” says John Sides, a political science professor at George Washington University."

Imagine You Were Raped. Got Pregnant. Then Your Rapist Sought Custody.

"The debate over Rep. Todd Akin's widely condemned comments on "legitimate rape" has largely centered on abortion and Republican efforts to outlaw the procedure, even in cases of rape. But the controversy has also uncovered a little-discuss ed issue: When some rape victims do choose to give birth to a child conceived through sexual assault, they find that the legal door is left wide open for their victimization to continue. It sounds unfathomable, but in many states the law makes it possible for rapists to assert their parental rights and use custody proceedings as a weapon against their victims."

The Doctor behind Akin's offensive unscientific statements

Update 8/27/12:

The Weekly Standard Defends Ryan on Redefining Rape

"More broadly, the "they only intended to exclude statutory rape" defense misses the point. Most serious abortion foes oppose the rape exception—full stop. It's no surprise that the abortion rights opponents who wrote H.R. 3 didn't foresee that simply narrowing the rape exception—a move far short of their preferred position—might provoke more controversy than opposing the rape exception itself."

...

"While I was reporting out the forcible rape story last year, one of the sources I called, a very accomplished woman, told me she had been a victim of statutory rape as a young teenager. Decades later, she nearly broke down about it on the phone while talking to a stranger. Should she have been denied the option of a Medicaid-funded abortion because her rape wasn't rapey enough?" (emphasis mine)

Politifact: Selection Bias or Bad Statistics

In a recent post where I critiqued a list of issues that should "keep discerning readers from trusting Politifact", I was alerted to an article examining potential selection bias in how Politifact chooses which statements to rate. The article, entitled "Selection Bias? PolitiFact Rates Republican Statements as False at 3 Times the Rate of Democrats," was written by Eric Ostermeier, "Research Associate at the Humphrey School's Center for the Study of Politics and Governance." This article has also been cited in a recent attack on fact checkers by The Weekly Standard (3-post critique: 1,2,3). Given the attention this article received, I thought it would be useful to see if this article actually gives any good reason to justify suspicion of selection bias at Politifact.
First off, it should be noted that selection bias occurs whenever a sample, taken for statistical analysis, has not been chosen randomly. It should be clear, given the title, as well as a few other indicators shown later, this article is focusing on party-related selection bias. However, we should not jump to too many conclusions yet. It is important to actually read the article to see if the title is even justified.

MISLEADING TITLES

" [TITLE:] Selection Bias? PolitiFact Rates Republican Statements as False at 3 Times the Rate of Democrats.

[BODY:] PolitiFact assigns "Pants on Fire" or "False" ratings to 39 percent of Republican statements compared to just 12 percent of Democrats since January 2010 "

The difference between the title and body is subtle, but incredibly important. The title suggests the trend of "false" ratings is an overall trend throughout the 4 1/2 year history of Politifact. However, the actual article just looks at an 11 month period, mostly 2010. The reader should take note that this is not a random sample. In fact, as I will show later on in this article, this distinction actually seriously challenges any possible conclusion of party-related selection bias.

A BIT OF BACKGROUND

" PolitiFact, the high profile political fact-checking operation at the St. Petersburg Times, has been criticized by those on the right from time to time for alleged bias in its grading of statements made by political figures and organizations. "

At least in my experience, these allegations are often incredibly poor (also see linked critiques for analysis of other articles alleging bias within Politifact).

" The organization (and now its more than a half dozen state offshoots) grades statements made by politicians, pundits, reporters, interest groups, and even the occasional comedian (anyone 'driving the political discourse') on a six point "Truth-O-Meter" scale: True, Mostly True, Half True, Barely True, False, and Pants On Fire for "ridiculously" false claims.

But although PolitiFact provides a blueprint as to how statements are rated, it does not detail how statements are selected.

For while there is no doubt members of both political parties make numerous factual as well as inaccurate statements - and everything in between - there remains a fundamental question of which statements (by which politicians) are targeted for analysis in the first place. "

Politifact actually does now provide a description of how it chooses its statements:  

"Every day, PolitiFact staffers look for statements that can be checked. We comb through speeches, news stories, press releases, campaign brochures, TV ads, Facebook postings and transcripts of TV and radio interviews. Because we can't possibly check all claims, we select the most newsworthy and significant ones. 
In deciding which statements to check, we ask ourselves these questions:

• Is the statement rooted in a fact that is verifiable? We don’t check opinions, and we recognize that in the world of speechmaking and political rhetoric, there is license for hyperbole.
• Is the statement leaving a particular impression that may be misleading?
• Is the statement significant? We avoid minor "gotchas"’ on claims that obviously represent a slip of the tongue.
• Is the statement likely to be passed on and repeated by others?
• Would a typical person hear or read the statement and wonder: Is that true?"

This page was not available when Ostermeier wrote this article, so I cannot criticize him for failing to notice it. However, it should be noted that Ostermeier's statement is no longer true (by no fault of his own, of course).

At this point, the article outlines its findings, drawing no conclusions at the moment.

IS IT APPROPRIATE TO DRAW CONCLUSIONS FROM 2010 ALONE?

Before we go any further, let us return to a previous point I wrote earlier. Remember the sample of posts from this article included all posts from January 2010 through January 2011. So we should ask ourselves if the chosen dates are truly arbitrary. To help answer this question,  I took a look, at data from 2007 to see if it differed from 2010 (note that when I say 2010 in this section, I'm including January 2011 to reflect Ostermeier's article):

 "Let's compare these results to the findings of Ostermeier for 2010:

•  Out of 39 statements rated "False" or "Pants on Fire," each main party received approximately 50% of the rulings. This is much different from 2010, where Republicans received 75.5% of these ratings.
• Politifact has devoted approximately equal time between Republicans (124, 52%)  and Democrats (110, 46%). This is nearly the same as 2010.
• Republicans were graded in the "False" or "Pants on Fire" categories 16% of the time (39% in 2010) while Democrats were rated in these categories 16% of the time as well (12% in 2010). This absolutely nowhere close to the "super-majority" found in 2010.
• 73% of Republican statements in 2007 received one of the top 3 ratings (47% in 2010) as opposed to 75% of Democratic statements (75% in 2010). When looking at "True" statements alone, Republicans beat Democrats with 5% more of their statements receiving the coveted award than Democrats. It is hard to see how one party was considered more or less truthful than the others. It depends on how much credit you give the "Half True" rating, as opposed to the "True" rating.
• Republicans received a slightly larger percentage of "Mostly False" ratings than Democrats (1.79%). This is the same as in 2010. However, this only results in a 2% difference between Republicans and Democrats for the bottom 3 ratings. This is MUCH different from the 28% difference in 2010. 

As you can see, the results from 2007 can seriously undermine many possible conclusions that a person could draw from the 2010 data."

OSTERMEIER STARTS POKING AT CONCLUSIONS

However, Ostermeier starts unjustly suggesting certain conclusions and not others.

" What is particularly interesting about these findings is that the political party in control of the Presidency, the US Senate, and the US House during almost the entirety of the period under analysis was the Democrats, not the Republicans.

And yet, PolitiFact chose to highlight untrue statements made by those in the party out of power. "(emphasis mine)

It sounds like Ostermeier has already come to the conclusion that Politifact is essentially guilty of party-related selection bias since they "chose to highlight untrue statements made by those in the party out of power." This does not necessarily mean Politifact is choosing these statements because they came from Republicans, just that they are the party out of power. The data from 2007 does not provide us with any hint as to the truth of this possibility. Neither party was really "in power" during that time. Democrats controlled both the House and Senate while Republicans controlled the White House. However, Ostermeier fails to ask a few questions:

• Do parties out of power tend to be  more likely to spread falsehoods, possibly in order to discredit the party in power (The party in power may not need to spread falsehoods as often since they are already in power)?
• Was there a sensational movement (such as the TEA Party) that may have caused  more air time to go towards the party out of power, increasing the chance of falsehoods (see first bullet)?
• Did the party out of power decide its number one priority should be to oust the current party from power? Do these kinds of campaigns tend to produce falsehoods?
• Did the party out of power feel the need to attack legislation (Obamacare) coming from the party in power, regardless of factual accuracy (See first bullet)?
• Was the party out of power often given uncritical air time from incredibly popular news outlets?

These are just some of the questions Ostermeier should have posed to readers before coming to the conclusion that Politifact "chose to highlight untrue statements made by those in the party out of power." Essentially, he neglected to ask if the party out of power (or the media) highlighted its own untrue statements?

OSTERMEIER DOES ACTUALLY MAKE A GOOD POINT

" An examination of the more than 80 statements PolitiFact graded over the past 13 months by ideological groups and individuals who have not held elective office, conservatives only received slightly harsher ratings than liberals. "

One would think this alone would challenge the suspicion of a liberal bias, maybe even the suspicion of Democrat-centered bias. Is Politifact biased against Republicans, but not Conservatives? That sounds like it would take quite a conspiracy theory-styled rationale to justify. In fact, could there be other possibilities that could explain this kind of trend in 2010?

•  Were there sensational primary elections within the Republican Party that may have contributed to extra coverage? Did this election deal with a bloc of furious voters, who may have been more prone to falsehoods?
• Could it be that at least a few former politicians became political commentators (also remember party out of power points)?

FINDING ANSWERS:

" When PolitiFact Editor Bill Adair was on C-SPAN's Washington Journal in August of 2009, he explained how statements are picked: 

"We choose to check things we are curious about. If we look at something and we think that an elected official or talk show host is wrong, then we will fact-check it."

If that is the methodology, then why is it that PolitiFact takes Republicans to the woodshed much more frequently than Democrats?

One could theoretically argue that one political party has made a disproportionately higher number of false claims than the other, and that this is subsequently reflected in the distribution of ratings on the PolitiFact site. "

First off, it should be noted that Bill Adair has essentially admitted Politifact's selection of statements is not actually random. However, since his selection criteria does no appear to be dependent on political affiliation, the criteria can still be thought of as random in regards to it.

Ostermeier does suggest a possible reason for why Republican politicians are getting the brunt of bad ratings. In fact, I can imagine a Democrat saying Ostermeier's data  "shows that Republicans are more prone to falsehoods than Democrats." Now, as our 2007 data shows, whatever trend Ostermeier found in 2010 did not exist in 2007. We could ask ourselves if something changed in the Republican Party (like the TEA Party) that may have made the party more likely to embrace falsehoods. Notice that the stats for Democrat statements were the same in 2007 as they were in 2010. The big difference came in Republican statements, possibly suggesting a change in the Republican party. Now I'm not saying this is definitely the answer. However, I see no evidence that eliminates this possibility in favor of any possibility involving party-related selection bias.

" However, there is no evidence offered by PolitiFact that this is their calculus in decision-making. "

I'm not 100% sure why he says "However." If one political party is making "a disproportionately higher number of false claims than the other," wouldn't one expect a random large sample of those statements to also contain a disproportionately higher number of false claims (leading to "false" ratings from fact checkers like Politifact)? I'm not sure what the discrepancy is. If it truly is the case that Republicans are making more false claims than Democrats, and Politifact has an approximately equal number of false claims for each party, would this not be an indication of party-related selection bias? Politifact would be trying, possibly with some kind of "fairness doctrine" to make Republicans look more honest than they truly are. As Bill Adair noted, "we choose to check things we are curious about. If we look at something and we think that an elected official or talk show host is wrong, then we will fact-check it." No mechanisms are in place to ensure some kind of contrived fairness when one political party is more likely than the other to play fast and loose with the truth.

"Nor does PolitiFact claim on its site to present a 'fair and balanced' selection of statements, or that the statements rated are representative of the general truthfulness of the nation's political parties or the elected officials involved. "

This is correct. However, as the Washington Post Glen Kessler pointed out in a recent interview with NPR "I don't really keep track of, you know, how many Democrats or how many Republicans I'm looking at until, you know, at the end of the year, I count it up." There is no indication Politifact does any different. So it may not be the case that Politifact highlights any explicit methods for ensuring fairness (contrived or not). However, as professional journalists, is it possible they employed standard journalistic practices of objectivity so common-sense they didn't see the need to mention them?

It is possible that, given the tendency for journalists to be themselves personally liberal, that we should expect party-related selection bias as a default? It is a possibility (like many others). However, unless the entire staff is liberal (a claim that would require evidence), one has to wonder if even a few conservative journalists may actually be enough to prevent other liberal journalists from falling prey to party-related selection bias. Remember, Politifact articles are reviewed by a panel of at least 3 editors, further decreasing the probability of party-related selection bias.

In addition, a person with that hypothesis would have to explain why ratings did not favor politicians from either party over the other in 2007. Did Democrats lie more in 2007, causing party-related selection bias to make it seem like Democrats were just as honest as Republicans? Or was Politifact just not biased back then, as opposed to now? At least one would need to be investigated before drawing any conclusions.

Overall, although Politifact does not explicitly call itself "fair and balanced" (one may actually be skeptical of news organizations that do), once cannot come to the conclusion that they aren't actually fair and balanced. This would be a classic "argument from ignorance."

"And yet... 

In defending PolitiFact's "statements by ruling" summaries - tables that combine all ratings given by PolitiFact to an individual or group - Adair explained: 

"We are really creating a tremendous database of independent journalism that's assessing these things, and it's valuable for people to see how often is President Obama right and how often was Senator McCain right. I think of it as like the back of a baseball card. You know - that it's sort of someone's career statistics. You know - it's sort of what's their batting average." (C-SPAN Washington Journal, August 4, 2009) "

I will admit Bill Adair does oversell the importance of Politifact's summaries and tables. Since the selected statements are not truly random, only so much can be extrapolated from them. It may be a good idea for Politifact to provide a disclaimer stating that statements from individual politicians are not randomly chosen. They are instead chosen via the criteria outlined in their "Principles." However, with no evidence that party-related selection bias is a factor in their decision making, there would be no reason to post any disclaimer to suggest it is a factor.

HOW FAR SHOULD THE MEDIA GO TO APPEAR UNBIASED?

" Adair is also on record for lamenting the media's kneejerk inclination to treat both sides of an issue equally, particularly when one side has the facts wrong. 

In an interview with the New York Times in April 2010, Adair said: 

"The media in general has shied away from fact checking to a large extent because of fears that we'd be called biased, and also because I think it's hard journalism. It's a lot easier to give the on-the-one-hand, on-the-other-hand kind of journalism and leave it to readers to sort it out. But that isn't good enough these days. The information age has made things so chaotic, I think it's our obligation in the mainstream media to help people sort out what's true and what's not." "

Bill Adair makes a good point. Why should the media present both sides equally when one side is clearly wrong? In addition, why should the media present both parties as being equally truthful when one is actually playing fast and loose with the truth? It would seem odd that a political party that once lambasted the Fairness Doctrine would have any problem with what Bill Adair is saying.

SHIFTING THE BURDEN OF PROOF

" The question is not whether PolitiFact will ultimately convert skeptics on the right that they do not have ulterior motives in the selection of what statements are rated, but whether the organization can give a convincing argument that either a) Republicans in fact do lie much more than Democrats, or b) if they do not, that it is immaterial that PolitiFact covers political discourse with a frame that suggests this is the case. "

This is an interesting quote. My original critique of this quote may have been a bit over-simplified¹. As a result I thought it would be better to do a bit more thorough job on this quote, due to the implications it contains:

Notice how his last statement claims that Politifact frames Republicans in a way that suggests they lie more than Democrats. Before judging the validity of the rest of this statement, it would probably be a good idea to see if Politifact even does this at all. First off, notice that Politifact has never had an overall Dem vs GOP report card. Ostermeier was the one who did this. So this means that certain conclusions one may be tempted to draw from Ostermeier's study are not ones people may necessarily draw from Politifact itself. This is because all Ostermeier did was total up all statements made by Democrats and Republicans, and compared them. Of course he could have easily done the same with any arbitrary breakdown of statements: Men versus women, majorities versus minorities, southerners versus northerners, etc... If we found similar disparities in the data to the Dem vs GOP data, would we be accusing them of covering "political discourse with a frame that suggests this is the case?" The ultimate problem is that, Politifact rates individuals (and specific groups), not overall groupings of those individuals. In fact, Adair's earlier statement about his report cards shows that he is really only focusing on individuals. If one were to infer any trend about an entire grouping of those individuals, not only would they would need a sufficient sample size of individuals within those groups, but they would also need to filter out individuals with only a few statements to their name. It should be clear to anyone with common sense that, when you only have a small number of statements from an individual, you cannot come to any conclusion about the honesty of that individual with any decent level of certainty. As a result, people with only a few grades to their names would have to be ignored. For example, if you eliminated candidates with fewer than 5 statements to their name in 2010, you would have to eliminate Jim DeMint, Kevin McCarthy, Mike Prendergast, Dan Coats, and whole host of others... This will probably leave you with a very small sample of individuals. Seeing as how there are literally thousands of Republican politicians at all levels of government, you cannot come up with a half-way reasonable level of certainty over the honesty of Republican politicians as a whole from just Politifact's ratings alone. These kinds of things should be pretty intuitive to people just looking at Politifact's articles and report cards. As a result, Politifact can hardly be blamed for creating a framework suggesting Republicans lie more when they have never actually done such a thing, unlike Ostermeier. So as a result, does Politifact have the burden to give Republicans a convincing argument that "Republicans in fact do lie much more than Democrats?" At the very least, this is a straw man since Politifact never even implicitly made that claim. It was an observation based on a context-ignoring analysis performed by Ostermeier himself.

But let's say Politifact did look at a large number of claims from a large number of politicians to where you can gauge the honesty of enough individuals from each party to come up with a conclusion that one party does in fact lie more than the other. If Politifact is merely presenting the data they found, without coming to any conclusion, does Politifact really have the burden of proof? Whatever conclusions that are made about the data must be supported by the person making the conclusion. So if we are stuck in some dichotomy where either Politifact is biased, or Republicans lie more, should Politifact be the one with the burden of proof? As we can see, the data is agnostic to either claim. So if Politifact is making no claims, yet someone wants to claim they are biased, is it Politifact's burden to prove that Republicans lie more to keep these people from being justified in their belief in Politifact's bias? As Ostermeier points out, it is not a question over whether or not Politifact can prove outright that they don't have "ulterior motives." However, if Politifact fails to answer either of Ostermeier's questions, what can be their conclusion? Ostermeier gives Republicans no questions of their own to answer before coming to a conclusion. And as Ostermeier's last paragraph shows, he is comfortable supporting one particular conclusion over any others:


OSTERMEIER CONCLUDES BIAS

" In his August 2009 C-SPAN interview, Adair explained how the Pants on Fire rating was the site's most popular feature, and the rationale for its inclusion on the Truth-O-Meter scale: 

"We don't take this stuff too seriously. It's politics, but it's a sport too." 

By levying 23 Pants on Fire ratings to Republicans over the past year compared to just 4 to Democrats, it appears the sport of choice is game hunting - and the game is elephants. " (emphasis mine)

Up until this point, Ostermeier has been pretty good at not owning the conclusion that his data suggests Democrat-favored selection bias at Politifact. He has appeared sympathetic to concerns of this sort of bias by specifically highlighting them and not investigating other possible explanations. However, this last paragraph indicates he does actually believe that there is some kind of bias of this sort at Politifact. However, his logic in regards to "Pants on Fire" ratings suffers from the same problems readers may have when concluding in favor of any kind of party-related selection bias at Politifact (see "Conclusion" below). He fails to investigate other possible causes, instead flipping the burden of proof on Politifact to demonstrate it is not in fact guilty. In fact, if he were to look back at 2007, he would see a near polar opposite trend of assignments for "Pants on Fire" ratings. Democrats were the recipients of over half the "Pants on Fire" ratings in 2007. In addition, they received twice as many "Pants on Fire" ratings as Republicans that year, despite the fact that Democrats actually had slightly fewer total statements rated. Now there weren't a lot of "Pants on Fire" ratings that year, but it is clear the trend from 2010 was absolutely non-existent in 2007. Shouldn't that make Ostermeier wonder what changed in 2010? Was it Politifact or the Republican Party? To my knowledge no evidence has been given for the former (or even suggested), yet the rise of the TEA Party in 2010 shows the latter is certainly true.

CONCLUSION

Although it is hard to draw too many conclusions from Ostermeier's data sets. A few questions still need to be investigated before coming to any conclusions (some of these come from a previous post):

•  Could it be that many of these statements came from a single issue (or small collection of issues) where Republicans may have been more likely to spread falsehoods? A month-by-month breakdown could be useful in this regard. This kind of breakdown could also help investigate the question as to whether the Republican primaries had anything to do with the trends in 2010, as I pointed out earlier.
• Could it be that the perceived rise of anti-intellectualism in the Republican Party has made it less likely to care about factual accuracy? 
• Could the Republican party be more ideological and less prone to checking facts that could challenge their ideology? 
• Could it be that the Republican tendency to call neutral fact-checking sites "biased" creates a tendency to play fast and loose with the truth, knowing their constituents already distrust any site that could shed light on their claims? 

These are all possibilities (although I am not necessarily claiming any of them to be true). So did the article control for or check any of these, or alert readers to these possibilities? NOPE.²

Throughout most of this article, Ostermeier presents interesting data for Politifact in 2010. Although there are many possible explanations of the data, Ostermeier only really focuses on one. In addition, he ignores at least one other for no better reason than he should have for ignoring the one he focuses on as well. Ostermeier fails to ask many questions, such as whether or not the trends he found in 2010 even existed in previous years. A quick analysis of Politifact in 2007 showed this is not the case for at least one year. In the end, Ostermeier makes it clear he thinks Politifact is guilty of party-related selection bias, succumbing to the same fallacies any reader would if he/she came to the same conclusion from the information presented in this article alone (not that other articles I've seen do any better).

Overall, this article demonstrates a particularly erroneous way of detecting bias. A mere look at ratings totals cannot give a reader much information about bias. Even if one were to tally up all of Politifact's articles, few conclusions could be reached. Out of Politifact's 4 1/2 years in fact checking, 3 have been under a Democrat president, and 3 1/2 under a Democrat controlled congress. With the possibility of the party out of power being more prone to spreading falsehoods, one cannot instantly jump to conclusions if Republicans end up having more bad ratings than Democrats. I admit that demonstrating bias can be very tough. However, if someone is having THAT much trouble demonstrating bias, maybe they should wonder if they are even justified in suspecting bias in the first place. If Ostermeier had done this, maybe this article would have been more useful. Instead this article is just another failed attempt to try and poison the well for Politifact.

¹ - Update 1-31-12: Original critique: "Why should the organization have to give a convincing argument that Republicans lie more than Democrats in order to convince Republicans they do not have ulterior motives? Essentially this is the argument that, unless Politifact gives evidence it does not has ulterior motives, Republicans are justified in believing it does. This again, is a textbook argument from ignorance (see link above). Shouldn't Republicans have to ask for somewhat definitive evidence that Politifact in fact does have ulterior motives before accepting that claim as true? In fact, couldn't the data found in this entire article point to Republicans politicians spreading more falsehoods than Democrat politicians in 2010 just as much as it could point to Politifact having ulterior motives? In fact, the data from 2007 significantly challenges the latter while having practically no effect on the former."

² - Update 1-31-12: I took this bulleted list from the "SHIFTING THE BURDEN OF PROOF" section and placed it in the conclusion, to help with the revised flow of the critique.

Supposed Politifact Bias In 2010 Non-Existent In 2007

In a recent post where I critiqued a list of issues that should "keep discerning readers from trusting Politifact", I was alerted to an article examining potential selection bias in how Politifact chooses which statements to rate. The article, entitled "Selection Bias? PolitiFact Rates Republican Statements as False at 3 Times the Rate of Democrats," was written by Eric Ostermeier, "Research Associate at the Humphrey School's Center for the Study of Politics and Governance." This article has also been cited in a recent attack on fact checkers by The Weekly Standard (3-post critique: 1,2,3). Given the attention this article received, I thought it would be useful to see if this article actually gives any good reason to justify suspicion of selection bias at Politifact.

First off, it should be noted that selection bias occurs whenever a sample, taken for statistical analysis, has not been chosen randomly. As any reader can plainly see, this article does not use a random sample of statements from Politifact. Ostermeier chose statements from January 2010 through January 2011. If these dates were truly arbitrary, then it would not matter that these samples were not chosen randomly. However, as I intend to show in this post, choosing different dates can lead to remarkably different results. I will do a point-by-point critique of Ostermeier's article in another post. However, I thought I would look to see if choosing different dates made a difference to Ostermeier's results.


IS IT APPROPRIATE TO DRAW CONCLUSIONS FROM 2010 ALONE?

It is interesting to read Ostermeier's findings and see just how badly Republican officeholders are favored in the lower ratings categories during 2010 (note that when I say 2010 in this post, I'm including January 2011 to reflect Ostermeier's article). However, remember what I said earlier about how these findings are not based on a truly random sample. This should beg the question over whether this trend has existed in previous years. I decided to do a quick analysis of the 8 months of 2007 when Politifact first started rating statements from politicians. I chose this time period because it was relatively short and easy to analyze. My results turned out to be quite a bit different from Ostermeier's:

 Let's compare these results to the findings of Ostermeier for 2010:

•  Out of 39 statements rated "False" or "Pants on Fire," each main party received approximately 50% of the rulings. This is much different from 2010, where Republicans received 75.5% of these ratings.
• Politifact has devoted approximately equal time between Republicans (124, 52%)  and Democrats (110, 46%). This is nearly the same as 2010.
• Republicans were graded in the "False" or "Pants on Fire" categories 16% of the time (39% in 2010) while Democrats were rated in these categories 16% of the time as well (12% in 2010). This absolutely nowhere close to the "super-majority" found in 2010.
• 73% of Republican statements in 2007 received one of the top 3 ratings (47% in 2010) as opposed to 75% of Democratic statements (75% in 2010). When looking at "True" statements alone, Republicans beat Democrats with 5% more of their statements receiving the coveted award than Democrats. It is hard to see how one party was considered more or less truthful than the others. It depends on how much credit you give the "Half True" rating, as opposed to the "True" rating.
• Republicans received a slightly larger percentage of "Mostly False" ratings than Democrats (1.79%). This is the same as in 2010. However, this only results in a 2% difference between Republicans and Democrats for the bottom 3 ratings. This is MUCH different from the 28% difference in 2010. 

As you can see, the results from 2007 can seriously undermine many possible conclusions that a person could draw from the 2010 data. The fact that the kind of results you see are dependent on the dates chosen show this is not a random sample. In fact, focusing solely on 2010 to hint at the possibility of Democrat-centered selection bias within Politifact would actually be an great example of cherry-picking data, a well known fallacy.

This is a great example of why every reader should remember his/her critical thinking cap when analyzing statistics. Don't leave home without it!

Weely Roundup - Eyewitness Testimony, Strong Currency Problems, Fair Taxes, and Portal-Mario (4/4/11-9/10/11)

Welcome to another edition of my Weekly Roundup, a collection of some of my favorite Facebook posts from this last week. I understand I post a lot of things Facebook and, for anyone who is interested but doesn't have the time to read them all, this will give them a chance to see what I consider to be the most important. I will also get a chance to elaborate a bit more on certain posts. I will try to do this on a weekly basis but we will see if it works out. I am busy with school so I may not get a chance to do this every week.

Eyewitness testimony is UNreliable

NPR: "Reliability Of Eyewitness Testimony Under Scrutiny":
Yet more evidence of the unreliability of eyewitness testimony. It turns out that, contrary to the opinion of the Supreme Court, witness certainty can be a very good indicator of the unreliability of an individuals eyewitness testimony.
Just how aware are you?
More on the unreliability of eyewitness testimony


Damn that economy!
What seems to be the biggest issue of the day? First Switzerland showed us that having a strong currency can actually make you quite weak. Paul Krugman complained about the changing political discussion in Washington. David Brooks challenged some uses government spending meant to "fix the economy." Finally, I took a look at a few articles dealing with the economic plans of both Obama and Romney.

NPR: "Switzerland: Too Strong For Its Own Good":
Conservatives often speak of the evils of inflation, mainly accusing inflation of destroying people's savings. However, there is another side to inflation. Harvard Economist Ken Rogoff has previously pointed out that inflation can ease the burden of household debt, a major factor in our current recession/contraction. Now Switzerland is showing the world that a strong currency can also hurt a country by reducing demand for exports. In the US this would surely exacerbate our already large trade deficit as well as reduce demand for US products overseas, which is currently around one tenth of our GDP (exports are nearly half of Swiss GDP).

Skeptoid: "Wi-Fi, Smart Meters, and Other Radio Bogeymen":
Brian Dunning takes on the claim that radio waves can be harmful. As the World Health Organization classifies them, one should take an equal amount of precaution with coffee and the earth's gravitational field (good luck on that one!)

Paul Krugman: "The Fatal Distraction":
Krugman makes the case he's been making on his blog for quite some time, only now in a concise manner in an op-ed. The focus on Austerity (in the short term) is demonstrably crippling the economy. Conservative theories about regulation and tax fears are unfounded. Consumer demand is down and savings are up. How much more evidence to they need?
Krugman points out where he thinks the stimulus was inadequate, also noting the dramatic increase in consumer savings.
Krugman also shows that there is currently a de facto policy of austerity.

David Brooks "Where The Jobs Aren't":
David Brooks challenges the perceived efficiency of the government attempting to directly create private sector jobs. I do not agree with much of what he says. However it is an interesting read.
On the success of renewable energy
On the calculations of cost per job analysis of government spending on jobs
On The effectiveness of capital gains taxes
The overall effectiveness of government spending

Eric Levine: "Obama versus Romney on Jobs":

"Recently, both Obama and Romney have basically given what may turn out to be competing economic plans in 2012 (As of the date of this post, I have yet to see a serious economic plan from Rick Perry). Obama released his plan during a speech on Thursday night (9-8-11). Mitt Romney has already released his plan on his website. This post is a collection of a few articles on those plans."

Fodder for climate skeptics
Of course I cannot go a week without posting at least a few articles on climate change. NASA explained a dip in sea level rise that will surely show up on a few climate skeptic blogs. I summarized the ongoing controversy over the Spencer paper. Finally, Skeptical Science released a booklet detailing an often uncovered effect of climate change.

NASA: "NASA Satellites Detect Pothole on Road to Higher Seas":
NASA comments on the recent temporary decrease in global sea levels. It is due to La Nina, not due to the "end of global warming."

"while 2010 began with a sizable El Niño, by year's end, it was replaced by one of the strongest La Niñas in recent memory. This sudden shift in the Pacific changed rainfall patterns all across the globe... So where does all that extra water in Brazil and Australia come from? You guessed it--the ocean... [Sea] level drops such as this one cannot last, and over the long-run, the trend remains solidly up."

Skeptical science also explains the situation.

Eric Levine: "Climate Change "Skeptics" Climax Too Early... Again":

"Yet another story of climate change "skeptics" getting excited about something that turns out to be nothing. Here is a summary of the latest story in the ongoing novel of climate-change-skeptic-sensationalism..."

Skeptical Science: "OA not OK: Booklet available":
With all the media attention given to global warming, we often forget that more dangers exist from climate change other than just rising temperatures.

"In July and August 2011 we posted a long series to introduce the chemistry of ocean acidification. We have lightly edited and compiled the posts into a booklet."

Political differences abound
Politics! Dear Gawd when will it stop! Ezra Klein took a look at a possible case of Republican hypocrisy. Gregory Mankiw cleared up a liberal misconception about taxes and the rich. I reviewed Paul Krugman's answer to Barry Goldwater's book. Politifact took a look at tax loopholes for outsourcing. Finally, Jed Graham covered an "ingenious" plan to fix Social Security.

Ezra Klein: "Why did the GOP turn against stimulus? Ask a psychologist.":

"The bottom line is this: Until quite recently, both parties supported the idea that you combat bad economies with stimulus spending. Now, during an extremely bad economy, the Republican Party has completely abandoned that position."

Greg Mankiw: "Fair Taxes? Depends What You Mean by ‘Fair’ ": Harvard Economist Greg Mankiw points out that, although some billionaires like Warren Buffet can write their way out of a hefty dose of taxes, most millionaires still pay a larger percentage of their incomes in taxes (30%+) than do most Americans. Whether or not this is fair is mostly a philosophical question. Politifact also points out that the "Warren Buffet" phenomena only really applies to the "mega rich." The highest income earners still pay the lion's share of taxes. David Frum also points out that a much better "sacrifice" for the rich to make would be supporting inflation as a method to help the economy recover.

Eric Levine: "Book Review: Krugman's Rallying Cry to Liberals":

I just finished Paul Krugman's 2007 book, The Conscience of a Liberal. I actually liked this book much more than I initially expected. It is a very entertaining and mostly easy read (I actually listened to the audible audio book). Paul Krugman details America's transition from the "Long Gilded Age" (pre-New Deal) to the "Great Contraction" (post New Deal til 1980s) when America's income distribution became more egalitarian. He then details the switch back, starting in the late 1970s, when the top income earners saw large gains in real income while mid and lower income earners saw only modest gains, if any at all. This was due primarily to the growth of "Movement Conservatism." He then makes the case that it is now (back in 2007) possible to once again to work towards closing the income gap.

Politifact: "Did Republicans oppose closing corporate tax loopholes for outsourcing?":

"The SEIU is correct that Republicans did fight against Democratic plans to close tax loopholes on multinational corporations.... The link between the multinationals' tax status and their outsourcing of jobs is not direct, and that's an important distinction."

Jed Graham: "AARP Sees ‘A Better Way To Approach (Social Security) Benefit Changes’":
The AARP has long been thought of as the group that opposes practically every proposed solution to the problems of Social Security. This is mainly due to the fact that they do not want any changes to hit current retirees. It is also due to the fact that most of these plans also "cut the safety net where it needs to be strongest — in very old age." However, John Rother of the AARP has now embraced a plan that should help fix the problems with social security, as well as increase worker efficiency.


Can they really do that?!
So long as they don't sell it for money..

kottke: "A Super Mario Bros version of Portal?!":
Yes, this is an actual game being developed - it is not a mod of any existing one.

Minority data shows a grim future for the GOP

Brookings: "America Reaches Its Demographic Tipping Point":
This is an interesting article:

The latest wave of 2010 Census data, released this week, confirms what earlier surveys have strongly hinted: virtually half of recent births in the U.S. are minorities...
Minorities now comprise at least 40 percent of infants in more than half of all states, with the white share of infants declining in all of them, with the exception of the District of Columbia. Especially large minority gains occurred in New England states, Connecticut, Rhode Island and Massachusetts, as well as rapidly growing states like Florida, Nevada and Georgia...

Hispanics are a large part of this dispersion. They comprise more than half of all infants in California, Texas, and New Mexico and are the largest source of births in Nevada and Arizona. Among minority births, they contribute the most in 26 states, including Midwest states like Wisconsin, Minnesota, Kansas, Nebraska, and Iowa. Blacks represent the largest minority in 17 states– all in the South except for Michigan, Missouri, Ohio, and Pennsylvania...
As America’s younger population becomes more diverse and spreads to broader parts of the country, we need forward looking political and civic leaders to bridge race-generational divides that are already fuelling issues like immigration and our ongoing budget battles over revenue and government spending choices.

This needs to be a wake up call for Republicans. Although the GOP has been making gains among young white voters, their popularity among blacks has remained minuscule. It was 6% in 2008 and 8% in 2011. The black population is growing in southern states, the GOP stronghold. Merely presenting black candidates does not work. They need to actually figure out how to communicate and sell their ideas, something that might no go well when they protest the 1964 Civil Rights Movement (for whatever reason) or attempt to remove social programs minorities rely upon.
Although the GOP fares a bit better with Hispanics at 22% favorable ratings, their popularity is shrinking. It is down 6% since 2008. This likely due to the fact that Republicans focus more on restricting illegal immigration than they do to comprehensive immigration reform. This doesn't seem likely to change anytime soon within the GOP. In fact, the problem seems to be getting worse.

So far this hasn't translated into a growing share of Democratic voters. 2% fewer Americans call themselves Democrats since 1990, while 3% fewer consider themselves Republicans. Independent voters have seen a rise. However, these Independent voters have the ability to swing most elections.

What does this tell us? Unless the GOP is willing to fundamentally change a few of its sacred views, the party is in severe danger of losing support in the long term.