There appears to be no political favoritism for or against either major political party in Google’s algorithm or search results, according to new research.
In recent months, questions have arisen about big tech’s unparalleled influence over what news and information people see online. Potential political bias and censorship in search engine results are a big part of the conversation. Is the concern well-founded?
Researchers reviewed the first page of Google search results for every candidate running for federal office in the 2018 US election over a six-month period. After a systematic audit of about 4 million URLs scraped from the search engine, they found that the results don’t exclude sources from either end of the political spectrum. For the most part, the researchers found that the news sources most commonly held a relatively centrist point of view.
“Our data suggest that Google’s search algorithm is not biased along political lines, but instead emphasizes authoritative sources,” says coauthor Jeff Hancock, a professor of communication at Stanford University.
“I think audits of large-scale algorithms that play such an important role in so many aspects of our lives are crucial. We need to be able to trust that these AI systems aren’t biased in important ways, and without audits, it’s difficult to assess these opaque algorithms.”
Looking for political bias in search results
“Recent studies have shown that web users are more likely to find and trust news through search than social media,” says first author Danaë Metaxa, a doctoral candidate in computer science. “We’ve also heard concern from many sources including the White House that search may be biased (for example against conservative media), a claim that our audit methodology is well-suited to investigate systematically and thoroughly.”
In their audit, the researchers focused on news sources that appeared on the first page of a Google search query for every candidate running for federal office in the 2018 election. This included over 3,000 candidates running for 225 seats in the US House of Representatives and the Senate. Of these, 878 candidates were on the ballot in the general election.
They focused on Google searches only because of its dominant market share in web search. About 90% of all searches are through Google, the researchers note.
To evaluate political bias in search results, the researchers focused on evaluating the news sources that appeared on the first page of a Google search result for the candidate. The researchers excluded social media platforms, personal campaign websites, and encyclopedia entries as they could not meaningfully label them with a partisanship score, the researchers note.
The researchers used a scoring method researchers at Harvard University’s Berkman Klein Center created for their analysis of mainstream media coverage of the 2016 United States presidential election.
In that work, the researchers assigned a partisan score to a source based on who shared their content over Twitter. They looked at some 44,000 users who they labeled as likely conservative or liberal. The researchers determined their political leanings by their retweets of the two general election party candidates—Donald Trump or Hillary Clinton. Rarely did users retweet both candidates. From there, the researchers were able to evaluate partisanship.
Here, Metaxa and Hancock applied those scores to the sources that appeared in their Google search results.
Examining the distribution of partisanship in their data set, the researchers found that overall, candidates’ search results were comprised mostly of centrist news sources that center-left news outlets slightly offset. The researchers did identify two large peaks of highly partisan sources on the left and especially the right, but in general, they found no bias for either party. Distribution was roughly normal, with a prevalence of centrist sites, they report in the paper.
“This is good news from a trust point of view, but more audits along more dimensions are needed,” Hancock says.
Centrist incumbents
The researchers also wanted to know what search engine results for a candidate might reveal about how elections played out in the real world.
They looked at how search engine results for candidates compared with their incumbency status. Political scientists have shown that incumbents are more moderate and centrist in their positions than challengers. Here, the researchers wanted to know whether search media would reflect that trend.
The researchers found that it did. Search inquiries for incumbent candidates resulted in a “strikingly” lower level of partisanship compared to challengers.
The researchers were also curious to know how that then compared to election outcome.
The researchers found that election winners and losers have very different search results—but these results might be attributed to a candidates’ incumbency status. Metaxa points out that political science has shown that a main effect driving election outcome is incumbency status; incumbents are overwhelmingly likely to win. The researchers’ data, consistent with political science theory, showed that incumbent candidates’ search results were more moderate and mainstream, compared with challengers.
Metaxa believes that with more work, there is a possibility for using search to gain real-time insight into elections, like a digital polling mechanism.
The paper appears in the Proceedings of the Association for Computing Machinery on Human-Computer Interaction.
Additional coauthors are from Stanford and the University of Illinois at Urbana-Champaign. Support for this research came from the John S. and James L. Knight Foundation and the Stanford Project on Democracy and the Internet.
Source: Stanford University
