Skip to main content
Menu
Marine Le Pen Is In A Much Deeper Hole Than Trump Ever Was

Emmanuel Macron, a centrist candidate, and Marine Le Pen, of the far-right-wing National Front, will advance to a runoff in the French presidential election after finishing in the top two positions in a first-round vote on Sunday. Macron is an overwhelming favorite to win the runoff on May 7. But we’re likely to hear two weeks of punditry that draws misleading comparisons between Le Pen, President Trump and Brexit — and that exaggerates Le Pen’s chances as a result.

Although vote counts are still being finalized, the first-round result should be a good one for pollsters, which correctly had Macron and Le Pen in the top two positions. In fact, the pre-election polls — which had shown Macron at 24 percent, Le Pen at 22 percent, the center-right François Fillon at 20 percent and the far-left-wing Jean-Luc Mélenchon at 19 percent — should come within a percentage point or two of the final result for each of the top four candidates.

The same polls show Macron in a dominant position in the runoff. He leads Le Pen by 26 percentage points in polls testing the two-way matchup, according to data compiled by G. Elliott Morris of The Crosstab.

And yet, observers of the race seem cautious about Macron’s chances. Betting markets give Le Pen a 13 percent chance — about 1 in 7. Ian Bremmer, a political scientist who runs The Eurasia Group, has given Le Pen a 40 percent chance, meanwhile. (Bremmer’s estimate wasn’t based on any sort of statistical model; he argues that the polls don’t reflect major elements of French politics.) And esteemed publications such as The Guardian are questioning whether the polls can be trusted at all, despite their accuracy on Sunday:

By contrast, polling-based models give Le Pen very little chance. Morris’s model, at The Crosstab, gives Le Pen a 3 percent chance of winning the runoff. And a model designed by The Economist puts Le Pen’s chances at less than 1 percent.

I worry about overconfident models — for a variety of reasons, statistical models can underestimate tail risks if they’re not designed carefully. In the U.S. election, models varied wildly in their estimates of Trump chances, from 29 percent in the FiveThirtyEight “polls-only” model to less than 1 percent according to the Princeton Electoral Consortium. A lot of those differences had to do with how these models analyzed the Electoral College, a complication that models predicting the French election don’t have to contend with. Still, I’m more comfortable with slightly more conservative estimates such as Morris’s than with The Economist’s.

But in my view, the conventional wisdom espoused by analysts such as Bremmer is more likely to be way more out to lunch. Before the U.S. election, Trump trailed Hillary Clinton by only about 2 percentage points in the average swing state.1 In the Brexit vote, the “Remain” campaign’s lead was at least as narrow: about 2 points according to a simple average of polls, or just 0.5 percentage points according to a more complex averaging method. So while Trump’s victory and Brexit were historic events in world history, they were utterly routine occurrences from a polling standpoint; 2- or 3-point polling errors are extremely common.

But while there were plenty of precedents for a polling error large enough to elect Trump, there aren’t all that many examples of a 26-point polling error, which is what Le Pen would need. Pundits and other political observers often have poor intuition when it comes to translating polls into probabilities, leading them to treat narrow, fragile leads the same as double-digit ones. Ironically, the same type of sloppy thinking that led people to underestimate the chances for the Trump and Brexit victories may lead them to overestimate Le Pen’s odds.

Of course, there are still two weeks to go until the runoff and it’s possible that Le Pen could narrow her deficit. But by the same token, Macron could expand his lead in the final weeks. Fillon, whose voters agree with Le Pen on some issues, has already endorsed Macron. So did Socialist candidate Benoît Hamon. And Le Pen faded down the stretch run of the first-round campaign, having regularly polled in the mid-to-high 20s in February and March before seeing her numbers decline to about 22 percent in the final polls and in the actual vote.

Some of the bullishness about Le Pen’s chances reflects the idea that there’s a lot of hidden support for Le Pen, perhaps among voters who say they are undecided. This is a version of the “shy Trump voter” theory of the American election, which says that people are afraid to tell pollsters that they support “politically incorrect” candidates. In the abstract, this theory could make some sense; pollsters have long worried about the effects of social desirability bias. A voter who held contemptuous views toward a racial minority group might not want to express those views in a phone call with a stranger conducting a poll, for instance.

However, there’s no evidence that candidates such as Le Pen systematically outperform their polls. Across dozens of European elections since 2012, in fact, nationalist and right-wing parties have been as likely to underperform their polls as to overperform them.

I’ve built a database that covers the performance of right-wing parties and candidates, such as Le Pen and the National Front, in European elections since 2012. (More specifically, the parties are those identified by the New York Times as being “right-wing”; they “range across a wide policy spectrum, from populist and nationalist to far-right neofascist.”) I found 47 elections during this period in which one of these parties competed and voters were regularly polled about it before the election. Some of these elections featured multiple right-wing parties or candidates, so there are a total of 66 data points.

On average, the right-wing parties were predicted to win 13.5 percent of the vote in polls conducted at the end of the campaign.2 And they wound up with an average of … 13.5 percent of the vote. Polls have been just as likely to overestimate nationalists as to underestimate them, in other words.

DATE COUNTRY ELECTION RIGHT-WING PARTY POLL AVG. ACTUAL
5/25/14 Hungary EU parliament Fidesz 58.7% 51.5%
5/22/16 Austria Presidential Freedom Party 51.8 49.7
12/4/16 Austria Presidential Freedom Party 50.7 46.2
4/6/14 Hungary Parliamentary Fidesz-KDNP 47.8 44.9
10/25/15 Poland Parliamentary Law and Justice 36.2 37.6
5/22/14 U.K. EU parliament UKIP 29.0 26.6
12/13/15 France Regional National Front 28.7 27.1
10/18/15 Switzerland Federal Swiss People’s Party 28.3 29.4
5/25/14 Poland EU parliament Law and Justice 27.7 31.8
4/24/16 Austria Presidential Freedom Party 26.4 35.1
5/25/14 Austria EU parliament Freedom Party 24.3 19.7
5/25/14 France EU parliament National Front 23.3 24.9
4/23/17 France Presidential National Front 22.3 21.7*
5/25/14 Belgium Federal New Flemish Alliance 20.2 20.3
9/29/13 Austria Legislative Freedom Party 20.1 20.5
4/6/14 Hungary Parliamentary Jobbik 19.3 20.2
5/25/14 Belgium EU parliament New Flemish Alliance 18.7 16.8
6/18/15 Denmark General Danish People’s Party 17.8 21.1
5/25/14 Finland EU parliament Finns Party 17.0 12.9
4/19/15 Finland Parliamentary Finns Party 16.5 17.7
5/25/14 Hungary EU parliament Jobbik 15.9 14.7
4/22/12 France Presidential National Front 15.8 17.9
5/22/14 Netherlands EU parliament Party for Freedom 15.0 13.3
6/17/12 France Legislative National Front 14.9 13.6
3/15/17 Netherlands General Party for Freedom 14.6 13.1
11/6/16 Bulgaria Presidential IMRO 14.5 15.0
5/7/15 U.K. General UKIP 13.0 12.9
9/12/12 Netherlands General Party for Freedom 12.3 10.1
9/14/14 Sweden General Sweden Democrats 10.6 12.9
4/9/17 Finland Municipal Finns Party 10.2 8.8
3/26/17 Bulgaria Parliamentary United Patriots 10.2 9.1
5/6/12 Greece Legislative Ind. Greeks 9.6 10.6
5/25/14 Greece EU parliament Golden Dawn 9.3 9.4
3/5/16 Slovakia Parliamentary Slovak National Party 9.1 8.6
5/12/13 Bulgaria Parliamentary Attack 7.9 7.3
1/22/12 Finland Presidential True Finns 7.4 9.4
9/20/15 Greece Legislative Golden Dawn 7.2 7.0
5/25/14 Belgium EU parliament Vlaams Belang 7.2 4.3
6/17/12 Greece Legislative Ind. Greeks 7.1 7.5
5/25/14 Belgium Federal Vlaams Belang 6.8 3.7
5/25/14 Germany EU parliament AfD 6.7 7.1
9/29/13 Austria Legislative Team Stronach 6.7 5.7
1/25/15 Greece Legislative Golden Dawn 6.2 6.3
5/25/14 Italy EU parliament Lega Nord 5.4 6.2
10/26/13 Czech Rep. Legislative Dawn 5.4 6.9
5/6/12 Greece Legislative Golden Dawn 5.4 7.0
6/17/12 Greece Legislative Golden Dawn 5.1 6.9
10/5/14 Bulgaria Parliamentary IMRO/NFSB 4.9 7.3
3/10/12 Slovakia Parliamentary Slovak National Party 4.5 4.6
5/25/14 Bulgaria EU parliament Attack 4.1 3.0
5/25/14 Czech Rep. EU parliament Dawn 4.0 3.1
5/25/14 Greece EU parliament Ind. Greeks 4.0 3.5
9/22/13 Germany Federal AfD 4.0 4.7
2/25/13 Italy General Lega Nord 3.9 4.1
1/25/15 Greece Legislative Ind. Greeks 3.8 4.8
5/25/14 Italy EU parliament National Alliance 3.8 3.7
5/6/12 Greece Legislative LA.O.S. 3.6 2.9
10/5/14 Bulgaria Parliamentary Attack 3.4 4.5
9/20/15 Greece Legislative Ind. Greeks 2.9 3.7
9/29/13 Austria Legislative BZÖ 2.9 3.5
11/2/14 Romania Presidential Greater Romania Party 2.4 3.7
2/25/13 Italy General National Alliance 2.1 2.0
3/5/16 Slovakia Parliamentary People’s Party 2.0 8.0
12/9/12 Romania Parliamentary Greater Romania Party 2.0 1.5
3/10/12 Slovakia Parliamentary People’s Party 1.5 0.9
5/25/14 Austria EU parliament BZÖ 1.4 0.5
6/17/12 Greece Legislative LA.O.S. 1.3 1.6
Average 13.5 13.5
European right-wing parties don’t really outperform their polls

For European elections with “right-wing” parties since 2012. Le Pen’s vote total reflects a preliminary estimate from Ipsos.

Sources: New York Times, Wikipedia, europarl.europa.eu

The same has been true in France, where the National Front has variously underperformed and outperformed its polls. In five elections since 2012, the National Front has averaged 21 percent in polls and finished with 21 percent of the vote.

In European elections since Trump’s win, in fact, the trend has been for nationalist candidates to perform disappointingly. Geert Wilders’ Party for Freedom faded badly down the stretch run in the Dutch general election and then underperformed its polls on election day last month. Meanwhile, Austria’s Norbert Hofer, of the Freedom Party of Austria, considerably underperformed his polls in a presidential re-vote last December. Trump isn’t popular in Europe, and his victory may have done candidates who emulate his rhetoric no favors.

There’s still some uncertainty about the outcome, however. Although the polls haven’t systematically underestimated nationalist and right-wing parties, they also haven’t been all that accurate in pinning down their support, having come in both high and low in different elections. In cases since 2012 where the right-wing party polled at 25 percent or more,3 the polls missed the party’s actual support by an average of 3.6 percent of the vote. That translates to a true margin of error (or 95 percent confidence interval) of about plus or minus 9 percentage points. And because any vote that Le Pen gets is one that Macron won’t get, the margin of error for the gap between Le Pen and Macron is twice as large, or about 18 percentage points.

An 18-point margin of error is huge! But it still isn’t enough when you’re 26 points behind, as Le Pen is against Macron. If Le Pen can significantly narrow her deficit with Macron over the next two weeks, Macron’s supporters will have reason to worry. If she still trails by something like 26 points on election day, however, a Le Pen victory would be essentially unprecedented. She could beat her polls by as much as Trump and Brexit combined4 and still lose to Macron by almost 20 points.

Footnotes

  1. As weighted by its probability of being the tipping-point state, according to FiveThirtyEight’s polls-only model. Trump also trailed Clinton by 3 to 4 percentage points in national polls, which correctly predicted that Clinton would win the popular vote.
  2. The average consists of the final poll of the campaign, plus any polls conducted within a week of the final poll. For instance, if the final poll was conducted on May 20 for a certain race, the average would consist of all polls conducted from May 13 to May 20. If there were fewer than three polls during this window, I used the last three polls before the election, regardless of when they were conducted. Polls are drawn from Wikipedia pages such as this one.
  3. Le Pen starts with 37 percent in her matchup against Macron.
  4. Per FiveThirtyEight’s calculation, Trump beat his swing state polls by just 2 to 3 points. And the “Leave” campaign beat its polls by a net of 4 to 6 percentage points.

Nate Silver is the founder and editor in chief of FiveThirtyEight.

Comments