A smart suitcase, called BBeep, and a way-finding smartphone app can help people with visual disabilities navigate airport terminals safely and independently, report researchers.
The rolling suitcase sounds alarms when users are headed for a collision with a pedestrian, and the navigation app provides turn-by-turn audio instructions to users on how to reach a departure gate—or a restroom or a restaurant. Both proved effective in a pair of user studies that took place at Pittsburgh International Airport.
Researchers have partnered with Pittsburgh International Airport in developing new systems and technologies for enhancing traveler experiences and airport operations.
“When you get a five- or six-hour layover and you need to get something to eat or use the restrooms, that is a major hassle.”
“Despite recent efforts to improve accessibility, airport terminals remain challenging for people with visual impairments to navigate independently,” says Chieko Asakawa, a professor in Carnegie Mellon University’s Robotics Institute and an fellow at IBM Research. Airport and airline personnel are available to help them get to departure gates, but they usually can’t explore and use the terminal amenities as sighted people can.
“When you get a five- or six-hour layover and you need to get something to eat or use the restrooms, that is a major hassle,” said one legally blind traveler who participated in a focus group as part of the research. “It would be lovely to be able to get up and move around and do things that you need to do and maybe want to do.”
Airport assistance in an app
An increasing number of airports have been installing Bluetooth beacons, which can be used for indoor navigation, but airports often deploy them to enhance services for sighted travelers, not to help blind people, says Kris Kitani, assistant research professor in the Robotics Institute.
He and his colleagues deployed NavCog, a smartphone-based app that employs Bluetooth beacons, at Pittsburgh International Airport. The app, which researchers developed with IBM to help blind people navigate independently, has been previously deployed on campuses and in shopping malls.
The researchers modified it for use at the airport, where extremely wide corridors make users vulnerable to veering, and for use with moving walkways. As part of the project, the airport installed hundreds of Bluetooth beacons throughout the facility.
“Part of our commitment to the public includes making sure our airport works for everyone, particularly as we modernize our facility for the future,” says Christina Cassotis, CEO of Pittsburgh International Airport.
The app gives audio directions to users. It relies on a map of the terminal annotated with the locations of restrooms, restaurants, gates, entrances, and ticketing counters.
Ten legally blind people tested the app using an iPhone 8 with good results, traversing the terminal’s large open spaces, escalators, and moving walkways with few errors. Most users could reach the ticketing counter in three minutes, traverse the terminal in about six minutes, go from the gate to a restroom in a minute, and go from the gate to a restaurant in about four minutes.
The NavCog app for iPhone is available for free from the App Store and can be used at Pittsburgh International in the ticketing area of the landside terminal and in the concourses and center core of the airside terminal.
The BBeep suitcase
Another team, including researchers from the University of Tokyo and Waseda University in Tokyo, developed the BBeep smart suitcase to help with another problem encountered in airports—navigating through crowds. The assistive system has a camera for tracking pedestrians in the user’s path and can calculate when there is a potential for collision.
“Sighted people will usually clear a path if they are aware of a blind person,” says Asakawa, who has been blind since age 14. “This is not always the case, as sighted people may be looking at their smartphone, talking with others or facing another direction. That’s when collisions occur.”
“People were noticing that I was approaching and people were moving away… giving me a path.”
BBeep helps clear a path. A rolling suitcase itself can help clear the way and can serve as an extended sensing mechanism for identifying changes in floor texture. BBeep, however, can also sound an alarm when collisions are imminent—both warning the user and alerting people in the area, enabling them to make room. A series of beeps begins five seconds before collision. The frequency of the beeps increases at 2.5 seconds. When collision is imminent, BBeep issues a stop sound, prompting the blind user to halt immediately.
In tests at the airport, six blind participants each wheeled BBeep with one hand and used a white cane in the other as they maneuvered through crowded areas. Researchers asked them to walk five similar routes in three modes—one where the suitcase gave no warnings, another in which only the user could hear the warnings through a headset, and another in which a speaker played the warnings. A researcher followed each participant to make sure no one was injured.
The researchers say the speaker mode proved most effective, both in reducing the number of pedestrians at risk of imminent collision and in reducing the number of pedestrians in the user’s path.
“People were noticing that I was approaching and people were moving away… giving me a path,” one user observed.
The researchers will present their findings at CHI 2019, the Association for Computing Machinery’s Conference on Human Factors in Computing Systems.
Additional coauthors of the report on BBeep are from Waseda University, the University of Tokyo, and the Robotics Institute. Additional researchers contributing to the NavCog research are from Carnegie Mellon and the University of Turin.
The National Science Foundation; the National Institute on Disability, Independent Living and Rehabilitation Research; the Allegheny County Airport Authority; and Shimizu Corp. sponsored both studies. The Japan Science and Technology Agency and Uptake provided additional support for BBeep.
Source: Carnegie Mellon University
