• Comment ()

The Devil Is in the Data

RNC Chairman Reince Priebus's "Growth and Opportunity Project" is missing a key concept: Experimentation.

March 22, 2013 RSS Feed Print
RNC Chairman Reince Priebus unveils his his post-election "autopsy" of the GOP.

RNC Chairman Reince Priebus unveils his his post-election "autopsy" of the GOP.

Adam Schaeffer is co-founder and director of research of Evolving Strategies.

The GOP's "Growth and Opportunity Project," which details a plan for revitalizing the Republican Party in the aftermath of the 2012 defeat, is necessarily broader than it is deep. There is, however, a topic that will need to be thoroughly explored if the Republican Party is to successfully execute this ambitious plan.

Two words were used nearly 300 times throughout the report: "data" and "testing." One word—"experiment"—was not mentioned at all. But experiments are the only type of test that can produce the kind of data the GOP needs.

Put simply, "data" is information about the world we live in, and it comes in two types: "observational" and "experimental." "Observational" data is static; it's information about the things as they are, or were. For example, voters who are pro-life are also less supportive of gun control. That's the world as it is. But it doesn't tell us whether being pro-life causes people to be more pro-gun or whether a pro-life message will decrease support for gun control.

[See a collection of political cartoons on gun control and gun rights.]

"Experimental" data is dynamic; it's information about what causes things to change and how things could be. Experiments show us how specific messages or modes of contact—like telephone calls, mailers or TV ads—push or pull on voter opinion and behavior. Experiments open our eyes to a counterfactual universe: what if every citizen watched this ad, knew that fact, or was visited at their door by a volunteer? Will it shift the vote or turn more people out to the polls? Will it work with some voters, but not others, or even cause a backlash?

The experimental method is simple in concept, but difficult in practice. The core of a true experiment is random assignment of a large number of test subjects to "treatment" and  "control" groups, like a clinical drug trial. With a large numbers, random assignment ensures there is no systematic bias in who ends up in each group. We can then attribute any difference in the outcome between the "treatment" and "control" group, whether that's blood pressure or support for a candidate, to the effect of the "treatment." It's the only way to confidently identify a causal relationship.

This all might sound far too fussy and academic, even philosophical, to be a core part of a political effort. But this is the new world of politics in which we're already living.

[Read the U.S. News Debate: Is the GOP's Problem in its Strategies or its Policies?]

What made the Obama campaign so accurate in their prediction of the vote across contested states was the use of experimental results from the "lab" and the "field" in their voter modeling. Because they had a large amount of experimental data, showing them how different kinds of people shifted in response to various messages (toward or away from Obama, greater or lesser likelihood of voting), they could predict with astonishing accuracy the aggregate results of their efforts.

Simply adding more observational data won't expand the ranks of the GOP. In Iowa's 2008 caucus, the Romney campaign turned out just under 30,000 votes and lost badly to a late-surging Mike Huckabee. Romney maintained his database on the state's voters. In 2011, his campaign commenced a quiet but ambitious "data-driven" effort to win Iowa. All the experience, information and algorithms hard-won over the last four years were plowed into a massive persuasion and turnout effort. But when their work was completed and the counting was done, Romney received just under 30,000 votes once again. Four years and millions of dollars later Romney had earned about 140 fewer votes and a loss to yet another late-surging social conservative.

Tags:
politics,
RNC,
Republican Party,
2012 presidential election

Reader Comments ()

advertisement

Latest Videos

Thomas Jefferson Street Blog

Poll Finds Congress' Popularity Hits Historic Lows

Polling shows Congress has achieved historic unpopularity.

House GOP 20 Week Abortion Ban Vote Was a Waste of Time

Abortion should be left up to the states.

The NSA, Guns and Privacy in the Obama Administration

The Obama administration’s needs to take a long look in the mirror after revelations about government surveillance.

Polls Show American People Hate Almost Everything About Politics

The American people are breaking up with politics.

Do You Believe NSA Leaker Edward Snowden or President Obama?

Should we take the word of the NSA leaker or Obama?

Obama, Boehner and the GOP Crisis of Leadership

It’s tough for anyone to lead when some in the GOP seem committed to their own destruction.

Obamacare Opponents Have to Keep Pushing Repeal

The way to repeal Obamacare is to hasten its ugly results.

Can Obama's Berlin Speech Match John F. Kennedy's and Ronald Reagan's?

The two famous Berlin speeches almost never were.

advertisement