The Minimal Effects of TV Debates Between Candidates

This is Naked Capitalism fundraising week. 1152 donors have already invested in our efforts to combat corruption and predatory conduct, particularly in the financial realm. Please join us and participate via our donation page, which shows how to give via check, credit card, debit card, or PayPal. Read about why we’re doing this fundraiser, what we’ve accomplished in the last year, and our current goal, burnout prevention.

Yves here. While we hope you all will join us for Lambert’s usual debate open thread tomorrow night, if nothing else as a way to keep on top of what will be the news event of the week without losing your sanity, this post serves as an important reminder that the stakes aren’t as high as the media would have you believe. In the US, the data suggests that unlike the mother of all televised debates, Kennedy v. Nixon in 1960, debates don’t do much to change voter views in the US. That may be due to the candidates having been well exposed to the electorate before the debates, so they already have a good sense of the contenders’ personalities and positions.

Another way to think about it is whatever shifting of voter views occurs during the debates could be offset or solidified by later developments. For instance, Obama, who was not doing well given his incumbent status in 2012, was widely perceived to have also dialed in his performance at the first debate with Romney, giving the challenger a further boost. But Obama prepped for the next three debates and was generally credited with having won them.

However, consistent with the thesis of this post, those debates likely had less impact than the release of a secret video taken at a Romney fundraiser. His remarks:

There are 47 percent of the people who will vote for the president no matter what. All right, there are 47 percent who are with him, who are dependent upon government, who believe that they are victims, who believe the government has a responsibility to care for them, who believe that they are entitled to health care, to food, to housing, to you-name-it. That that’s an entitlement. And the government should give it to them. And they will vote for this president no matter what…These are people who pay no income tax.

Funny how this is a mirror image of Hillary Clinton’s self-destructive “basket of deplorables” declaration.

By Caroline Le Pennec, Incoming Assistant Professor, HEC Montréal; Vincent Pons, Assistant Professor of Business Administration, Harvard Business School, and Faculty Research Fellow at NBER; Vestal McIntyre, writer and editor on development economics for the Economic Growth Center at Yale University, and other organizations. Originally published at VoxEU

The first televised debate between US President Donald Trump and Democratic challenger Joe Biden will take place next week. But while it is being portrayed as a make-or-break moment in the campaign, this column argues that TV debates between candidates do not substantially impact vote choice. Instead, a campaign wishing to sway last-minute voters might do better by focusing on individual outreach – a challenging prospect, given the Covid-19 pandemic.

The first televised debate between US President Donald Trump and Democratic challenger Joe Biden will take place on 29 September. The US media often portrays this as a make-or-break moment in the campaign. One CNN analysis claims that “[t]he best opportunity [Trump] will have to alter the race’s trajectory is the three debates with Biden, especially the first one, on September 29, since traditionally that is the one that draws the most viewers,” and Vanity Fair magazine says that “[t]he presidential debates of 2020 will likely be this country’s most dramatic and consequential political theater of the 21st century.”

But how many voters will change their choice based on what they see?

A large number of US-based studies examine this question. While some conclude that TV debates truly matter (e.g. Hillygus and Jackman 2003), others find modest or even null effects on vote choice (e.g. Shaw 1999). However, these studies generally focus on a unique election or a small number of races in the same country, and so their estimates may capture the effects of concomitant events and underlying time trends.

Another set of studies use rigorous experimentation in developing countries and find that debates can build voter knowledge and affect voter choice (Brierley et al. 2019, Bidwell et al. 2019, Platas and Raffler 2019, Bowles and Larreguy 2020). Brierley et al. (2019) show debates also reduce polarisation in Ghana, while for Sierra Leone Bidwell et al. (2019) trace the effects all the way through to the behaviour of elected members of parliament, and give evidence that debates increase accountability and lead to policy change.

However, these studies are quite far removed from the US electoral season, focusing instead on debates in low-income democracies with scarce information. The debates feature parliamentary candidates (not executives) and they are not televised but featured on smartphones, in public gatherings, or on the radio.

In a new paper, two of us – Caroline and Vincent – use survey data from 62 elections in ten OECD countries to begin to fill this knowledge gap (Le Pennec and Pons 2020). Voters are surveyed not once, but twice – before and after election day – which provides new detail on how and when they make their choices.

We find that across the sample of countries, a significant portion of survey respondents can still be swayed in the last 60 days in a campaign – enough to change the outcomes of many elections. However, this share is far lower in the US, and across all countries and elections considered, TV debates do not substantially impact vote choice.

This suggests a campaign wishing to sway last-minute voters might do better by focusing on individual outreach – a challenging prospect, given the Covid-19 pandemic.

The Surveys

In the paper, we seek to identify the overall impact of information voters receive across an electoral season, and how that compares to other factors such as party affiliation in determining their vote. We assemble a dataset of nationally representative surveys conducted around 62 elections in ten countries from 1952 to 2017, resulting in a total of 253,000 observations.

These surveys entailed interviewing a new set of people every day before the election to elicit their voting intentions, then interviewing them again after the election to record their actual vote choice. Comparing voters’ responses to the two surveys reveals whether they had actually settled on their final vote choice by the time of the pre-electoral survey, removing recollection bias which can arise when asking voters when they made their choice and what made them choose.

The paper sheds light on a number of determinates of voter choice, such as policy preferences (information received during the electoral season does not appear to affect policy preferences expressed before and after an election), candidate electability (surveys suggest that voters’ beliefs on candidates’ attributes and policy positions matter more than beliefs on their chances of victory), and the perceived importance of different issues (which changes during the campaign and correlates with shifts in vote choices).

But three of the findings speak directly to the possible effects of the 29 September debate:

1. Across the sample, sufficient numbers of voters make their choice in the final two months to sway many elections

As Figure 1 shows, the surveys reveal that the fraction of people with identical pre-election vote intention and post-election vote declaration increases by 17 percentage points over the last 60 days before the election, from a baseline of 71%. That increase comes both from respondents becoming more willing to state any vote intention, and from that statement becoming more consistent with their final reported vote.

Figure 1 Vote choice consistency as a function of the number of days relative to the election

2. Far fewer voters are subject to last-minute changes in the US than other countries

The influence of campaigns on vote choice has been relatively stable for the last 70 years but it varies substantially from one country to another.

Figure 2 represents this, by showing vote choice consistency across countries and over time. For each election, we estimate the average daily increase in the fraction of people with identical vote intention and vote declaration in the last 60 days before the election. The figure plots these election-specific estimates – the daily increases in vote choice consistency – against election year, along with country-level linear fits. The share of voters who change their mind in the final two months of an election season is much lower in the US than in other countries and this has changed little over the decades.

Figure 2 Average daily increase in vote choice consistency across countries and over time

3. TV debates change few minds

The study sheds light on the effects of 56 TV debates in 31 elections in seven countries, which not only gives the results the advantage of statistical power, but also a broader focus than studies such as Hillygus and Jackman (2003) and Shaw (1999), which focus on a few elections in a single country.

The methodology confers two further advantages in identifying the effects of debates. First, the fact that there are many debates in the samples decreases the risk that the event study captures the effect of other shocks affecting vote choice – as we can reasonably assume such shocks should be uncorrelated with the dates of debates. And second, debates took place at different times in different elections, which allows an ability to control flexibly for the consistency of vote choice that rises non-linearly in the 60 days leading to the election, as we saw in Figure 1. In other words, effects of debates can be disentangled from those underlying time trends.

The results show no significant impact of TV debates on individual consistency between vote intentions and vote choices expressed before and after an election – or any of the other relevant factors considered, such as voter policy preferences, issue salience, or beliefs on candidates. Thanks to the precision of the estimates, we can reject any impact higher than 0.5 percentage points on vote choice consistency, on average. Furthermore, debates do not contribute to vote choice formation for any type of voters and in any context, including close and uncertain races.

If Not Debates, What Will Sway Last-Minute Voters?

Unlike televised debates, door-to-door canvassing by political activists has a strong potential to mobilise and persuade voters – at least in France, according to a series of studies one of us (Vincent) conducted with co-authors. It can bring in new voters through registration (Braconnier et al. 2017) and mobilise a party’s existing supporters to vote (Pons and Liegey 2019).

Vincent also gave evidence that canvassing can perform that function so often attributed to TV debates – changing minds. He embedded a countrywide experiment in François Hollande’s campaign in the 2012 French presidential election (Pons 2018), randomising who received visits as an estimated 80,000 left-wing activists knocked on 5 million doors to encourage people to vote for Hollande. The study found that canvassers did not affect turnout, but increased Hollande’s vote share by 3.2 percentage points in the first round and 2.8 points in the second, accounting for a quarter of his victory margin.

What bearing will these findings have on an election in the United States, and especially one taking place during a global pandemic? Republicans and Democrats are taking a dramatically different approach to field work. Donald Trump’s campaign recently claimed to have knocked on 1 million doors in one week, while Joe Biden’s campaign knocked on zero, choosing instead to focus on safer methods such as phone calls, texts, and virtual organising.

It is hard to say if such efforts will change many voters’ minds, but if past evidence holds true, the TV debates will not.

See original post for references