A battery-like device could act as an artificial synapse within computing systems intended to imitate the brain’s efficiency and ability to learn, according to new research.
The brain’s capacity for simultaneously learning and memorizing large amounts of information while requiring little energy has inspired an entire field to pursue brain-like—or neuromorphic—computers.
A team of researchers previously developed one portion of such a computer: a device that acts as an artificial synapse, mimicking the way neurons communicate in the brain.
In Science, the team reports that a prototype array of nine of these devices performed even better than expected in processing speed, energy efficiency, reproducibility, and durability.
Looking forward, the team members want to combine their artificial synapse with traditional electronics, which they hope could be a step toward supporting artificially intelligent learning on small devices.
“If you have a memory system that can learn with the energy efficiency and speed that we’ve presented, then you can put that in a smartphone or laptop,” says coauthor Scott Keene, a graduate student in the lab of co-senior author Alberto Salleo, professor of materials science and engineering at Stanford University.
“That would open up access to the ability to train our own networks and solve problems locally on our own devices without relying on data transfer to do so.”
Emulating the human brain
The team’s artificial synapse is similar to a battery, modified so that the researchers can dial up or down the flow of electricity between the two terminals. That flow of electricity emulates how learning is wired in the brain. This is an especially efficient design because data processing and memory storage happen in one action, rather than a more traditional computer system where the data is processed first and then later moved to storage.
Seeing how these devices perform in an array is a crucial step because it allows the researchers to program several artificial synapses simultaneously. This is far less time consuming than having to program each synapse one-by-one and is comparable to how the brain actually works.
“…when we saw everything light up, it was like a Christmas tree. That was the most exciting moment.”
In previous tests of an earlier version of this device, the researchers found their processing and memory action requires about one-tenth as much energy as a state-of-the-art computing system needs in order to carry out specific tasks.
Still, the researchers worried that the sum of all these devices working together in larger arrays could risk drawing too much power. So, they retooled each device to conduct less electrical current—making them much worse batteries but making the array even more energy efficient.
The three-by-three array relied on a second type of device—which coauthor Joshua Yang developed at the University of Massachusetts, Amherst—that acts as a switch for programming synapses within the array.
“Wiring everything up took a lot of troubleshooting and a lot of wires. We had to ensure all of the array components were working in concert,” says Armantas Melianas, a postdoctoral scholar in the Salleo lab. “But when we saw everything light up, it was like a Christmas tree. That was the most exciting moment.”
During testing, the array outperformed the researchers’ expectations. It performed with such speed that the team predicts they’ll need to test the next version of these devices with special high-speed electronics.
After measuring high energy efficiency in the three-by-three array, the researchers ran computer simulations of a larger 1,024-by-1,024 synapse array and estimated that it could be powered by the same batteries currently used in smartphones or small drones. The researchers were also able to switch the devices over a billion times—another testament to its speed—without seeing any degradation in its behavior.
“It turns out that polymer devices, if you treat them well, can be as resilient as traditional counterparts made of silicon. That was maybe the most surprising aspect from my point of view,” Salleo says.
“For me, it changes how I think about these polymer devices in terms of reliability and how we might be able to use them.”
Future tests
The researchers haven’t yet submitted their array to tests that determine how well it learns but that is something they plan to study. The team also wants to see how their device weathers different conditions—such as high temperatures—and to work on integrating it with electronics. There are also many fundamental questions left to answer that could help the researchers understand exactly why their device performs so well.
“We hope that more people will start working on this type of device because there are not many groups focusing on this particular architecture, but we think it’s very promising,” Melianas says. “There’s still a lot of room for improvement and creativity. We only barely touched the surface.”
Additional coauthors are from Stanford; Sandia National Laboratories; and University of Massachusetts, Amherst. Funding for the work came from Sandia National Laboratories, the US Department of Energy, the National Science Foundation, the Semiconductor Research Corporation, the Stanford Graduate Fellowship fund, and the Knut and Alice Wallenberg Foundation for Postdoctoral Research at Stanford.
Source: Stanford University
