On secondhand marketplaces like eBay, people trust online sellers who post their own high-quality photos of items for sale more than they trust those who use stock images or poor-quality photos, according to a new study.
The findings could help online marketplaces improve trust in their sites by offering guidelines on how to take better photos or introducing augmented reality features that instruct users to change lighting or camera angles, the researchers say.
This is particularly important for new or growing sites that are working to establish trust, says lead study author Xiao Ma, a doctoral student in the field of information science at Cornell Tech.
“The high-quality product images selected by our model automatically outperform stock images in generating perceptions of trustworthiness,” says Ma. “People believe the user-generated images represent the actual condition of the product better. Stock images present more uncertainty and raise questions such as whether they are too good to be true.”
The study grew out of previous work on trust. Trust is essential for society to function, but research shows levels of trust have been declining in recent years. Establishing and building trust in digital environments is even more complex.
“Without face-to-face interactions there is a lot of uncertainty,” Ma says. “You don’t know what’s going on on the other side of the screen. People could lie; they could post different images. In the beginning of e-commerce there were a lot of studies on trust, but that was limited because our ability to understand images and language computationally has been limited.
“Now, because of computer vision and natural language processing, we’re able to understand a lot of these online interactions better, and there’s an opportunity to revisit these questions of online trust,” Ma says.
Image algorithm
For the study, the researchers used publicly available data from the mobile classifieds app Letgo.com and private data from eBay. They focused on shoes and handbags because they’re among the most popular goods on secondhand marketplaces, and because they are visually distinctive enough to pose an interesting computer vision challenge.
Using the images, they developed a deep learning algorithm—a kind of artificial intelligence frequently used for classification tasks—to predict image quality. They found the algorithm to be around 87 percent accurate, but because of the way deep learning works, researchers could not tell how the model arrived at its decisions. To learn more about which elements improve an image, they also analyzed images using classic computer vision methods and linear regression, a kind of statistical modeling.
Among their findings: Images are more likely to qualify as high quality if they are brighter, and less likely if they have a high foreground to background ratio. A good-quality image should have high contrast for the product and low contrast for the background, researchers found.
Trust and sales
Once they had established methods of predicting quality, the researchers investigated its impact on sales and consumer trust. Shoes with higher-quality images were 1.17 times more likely to sell than those with lower-quality images, and handbags with better photos were 1.25 times more likely to sell. But because sales are also subject to factors such as price, further research is necessary, Ma says.
To test trustworthiness, the researchers designed three hypothetical marketplaces and populated one of them with high-quality images, one with low-quality images, and one with stock photos. They recruited 300 people to rate the marketplaces from one to five on a series of statements gauging trust.
The site with the better images scored the highest, with participants rating it around 3.8 for the statement “I believe that the products from these sellers will meet my expectations when delivered,” compared with around 3.7 for the site using stock imagery and 3.4 for the site with low-quality images.
The results—which surprised researchers, who did not expect high-quality personal images to perform better than stock imagery—could be especially helpful to new sites, which might introduce features to improve the quality of users’ photos. For example, instead of automatically using the first uploaded image as a thumbnail, apps could use an algorithm to choose the best-quality image. The research could also be applicable to other kinds of sites, such as real estate or dating.
“Digital environments create new challenges and opportunities for different types of trust,” Ma says. “A lot of the challenge in starting online platforms is in gaining the users’ trust to have people adopt it.”
The researchers will present their study at WACV 2019. A Facebook equipment donation and Oath, which is part of Verizon, and Yahoo Research through the Connected Experiences Lab provided support for the research.
Source: Cornell University