A robot can successfully slide hospital gowns onto people’s arms, a potential first step towards dressing people.
The machine doesn’t use its eyes as it pulls the cloth. Instead, it relies on the forces it feels as it guides the garment onto a person’s hand, around the elbow, and onto the shoulder.
More than 1 million Americans require daily physical assistance to get dressed because of injury, disease, and advanced age. Robots could potentially help, but cloth and the human body are complex.
“The more robots can understand about us, the more they’ll be able to help us…”
The new machine, a PR2, taught itself in one day, by analyzing nearly 11,000 simulated examples of a robot putting a gown onto a human arm. Some of those attempts were flawless. Others were spectacular failures—the simulated robot applied dangerous forces to the arm when the cloth would catch on the person’s hand or elbow.
From these examples, the PR2’s neural network learned to estimate the forces applied to the human. In a sense, the simulations allowed the robot to learn what it feels like to be the human receiving assistance.
“People learn new skills using trial and error. We gave the PR2 the same opportunity,” says Zackory Erickson, the lead PhD student on the research team. “Doing thousands of trials on a human would have been dangerous, let alone impossibly tedious. But in just one day, using simulations, the robot learned what a person may physically feel while getting dressed.”
The robot also learned to predict the consequences of moving the gown in different ways. Some motions made the gown taut, pulling hard against the person’s body. Other movements slid the gown smoothly along the person’s arm. The robot uses these predictions to select motions that comfortably dress the arm.
After success in simulation, the PR2 attempted to dress people. Participants sat in front of the robot and watched as it held a gown and slid it onto their arms. Rather than vision, the robot used its sense of touch to perform the task based on what it learned about forces during the simulations.
“The key is that the robot is always thinking ahead,” says Charlie Kemp, an associate professor biomedical engineering department at Georgia Tech and Emory University and the lead faculty member on the project. “It asks itself, ‘if I pull the gown this way, will it cause more or less force on the person’s arm? What would happen if I go that way instead?'”
The researchers varied the robot’s timing and allowed it to think as much as a fifth of a second into the future while strategizing about its next move. Less than that caused the robot to fail more often.
“The more robots can understand about us, the more they’ll be able to help us,” Kemp says. “By predicting the physical implications of their actions, robots can provide assistance that is safer, more comfortable, and more effective.”
Abstract thinking makes robots better planners
The robot is currently putting the gown on one arm. The entire process takes about 10 seconds. The team says fully dressing a person is something that is many steps away from this work.
The researchers will present a paper on the robot in Australia during the International Conference on Robotics and Automation (ICRA). The work is part of a larger effort on robot-assisted dressing that the National Science Foundation funds and Liu leads.
An NSF award, AWS Cloud Credits for Research, and the NSF NRT Traineeship funded the research in part. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the sponsors.
Kemp is a cofounder, a board member, an equity holder, and the CTO of Hello Robot Inc., which is developing products related to this research. This research could affect his personal financial status. Georgia Tech has reviewed and approved the terms of this arrangement in accordance with its conflict of interest policies.
Source: Georgia Institute of Technology
