Self-driving cars struggle when navigating social interactions in traffic like whether to yield to something or someone in the road or continue driving, researchers report.
Should I go or give way? It is one of the most basic questions in traffic, one that humans typically make quickly and intuitively, because doing so relies on social interactions trained from the time we begin to walk.
Self-driving cars on the other hand, aren’t as adept, according to the new study. An analysis of videos uploaded by YouTube users of self-driving cars in various traffic situations shows that self-driving cars have a particularly tough time understanding when to yield.
“The ability to navigate in traffic is based on much more than traffic rules. Social interactions, including body language, play a major role when we signal each other in traffic. This is where the programming of self-driving cars still falls short,” says Barry Brown, professor at the University of Copenhagen who has studied the evolution of self-driving car road behavior for the past five years.
“That is why it is difficult for them to consistently understand when to stop and when someone is stopping for them, which can be both annoying and dangerous.”
‘Sorry, self-driving car!’
Companies like Waymo and Cruise have launched taxi services with self-driving cars in parts of the United States. Tesla has rolled out their FSD model (full self-driving) to about 100,000 volunteer drivers in the US and Canada. And the media is brimming with stories about how good self-driving cars perform.
But according to Brown and his team, their actual road performance is a well-kept trade secret that very few have insight into. Therefore, the researchers performed in-depth analyses using 18 hours of YouTube footage filmed by enthusiasts testing cars from the back seat.
One of their video examples shows a family of four standing by the curb of a residential street in the United States. There is no pedestrian crossing, but the family would like to cross the road. As the driverless car approaches, it slows, causing the two adults in the family to wave their hands as a sign for the car to drive on. Instead, the car stops right next to them for 11 seconds. Then, as the family begins walking across the road, the car starts moving again, causing them to jump back onto the sidewalk, whereupon the person in the back seat rolls down the window and yells, “Sorry, self-driving car!”
“The situation is similar to the main problem we found in our analysis and demonstrates the inability of self-driving cars to understand social interactions in traffic. The driverless vehicle stops so as to not hit pedestrians, but ends up driving into them anyway because it doesn’t understand the signals. Besides creating confusion and wasted time in traffic, it can also be downright dangerous,” Brown says.
Driving’s social element
In tech-centric San Francisco, the performance of self-driving cars can be judged up close. Here, driverless cars have been unleashed in several parts of the city as buses and taxis, navigating the hilly streets among people and other natural phenomena. And according to the researcher, this has created plenty of resistance among the city’s residents.
“Self-driving cars are causing traffic jams and problems in San Francisco because they react inappropriately to other road users. Recently, the city’s media wrote of a chaotic traffic event caused by self-driving cars due to fog. Fog caused the self-driving cars to overreact, stop, and block traffic, even though fog is extremely common in the city,” Brown says.
Robotic cars have been in the works for 10 years and the industry behind them has spent over DKK 40 billion (about $5.7 billion) to push their development. Yet the outcome has been cars that still drive with many mistakes, blocking other drivers and disrupting the smooth flow of traffic.
So why is it so difficult to program self-driving cars to understand social interactions in traffic?
“I think that part of the answer is that we take the social element for granted. We don’t think about it when we get into a car and drive—we just do it automatically,” Brown says.
“But when it comes to designing systems, you need to describe everything we take for granted and incorporate it into the design. The car industry could learn from having a more sociological approach. Understanding social interactions that are part of traffic should be used to design self-driving cars’ interactions with other road users, similar to how research has helped improve the usability of mobile phones and technology more broadly.”
The researchers presented the study at the 2023 CHI Conference on Human Factors in Computing Systems.
Source: University of Copenhagen
