People disproportionately find polls more credible when their preferred candidate is leading, according to a new study.
The study also implies that there are potential benefits of emphasizing polls’ methodological quality to mitigate people’s biases.
“On a number of fronts, it is clear that people believe what they want to believe,” says Josh Pasek, an associate professor of communication and media at the University of Michigan. “It’s depressing, but not really surprising, that they are willing to cherry pick which polls to trust in ways that support the narrative they want to hear.”
Pasek says the results pose a challenge for democratic legitimacy in a polarized society.
“When Republicans and Democrats have diverging expectations, it is likely that many people will be surprised by the result on Election Day,” he says. “These sentiments can validate perceptions of fraud, where people think that their expectations were upended because their opponents must have done something illegitimate.”
Coauthor Michael Traugott, a research professor at the Institute for Social Research, says their study extends previous research showing that people find poll reports of how the public feels about policies like abortion or gun control more accurate and credible when the results conform to their own views on those issues.
“The process of motivated reasoning, especially in our currently polarized environment, is complicating civil discourse about politics,” Traugott says. “The evidence available through well-conducted polls is not subject to evaluations based on their methodological quality. Accuracy and credibility are assessed in terms of whether the results confirm preexisting attitudes and beliefs.”
Pasek and Traugott, along with lead author Ozan Kuru of the University of Pennsylvania, conducted an experiment leading to the 2016 presidential elections. They evaluated how partisan biases, poll results, and methodological quality shapes people’s assessment of polling accuracy and expectations.
Using two polls, the data collected involved online surveys from a nationally representative sample of more than 900 people. The participants saw a screenshot of a news article about two election polls about the candidates: Hillary Clinton and Donald Trump.
The researchers manipulated the polls showing the same or different candidates leading, and whether the polls were either high- or low-quality. They asked respondents to rate the accuracy of the polls and to render a prediction about what would happen if the election were held the next day.
In one poll, researchers measured credibility of the perceived accuracy. Respondents had to indicate which poll they believed accurately represented the public support for the candidates.
A key finding involved how education factored into the responses. More educated respondents were more likely to identify high-quality polls accurately, while lower educated individuals’ bias was reduced when they encountered polls with varying methodological quality, the study shows.
The researchers say the biases identified in the study have potentially deleterious outcomes for democracy.
“Biased perceptions of polls can affect election turnout and voting preferences,” says Kuru, noting that highlighting methodological quality can lessen voters’ biases.
The findings appear in the International Journal of Public Opinion Research.
Source: University of Michigan
