A deep learning computer system taught itself to accurately predict extreme weather events, like heat waves, up to five days in advance using minimal information about current weather conditions.
Ironically, the self-learning “capsule neural network” uses an analog method of weather forecasting that computers made obsolete in the 1950s. During training, it examines hundreds of pairs of maps. Each map shows surface temperatures and air pressures at five-kilometers height, and each pair shows those conditions several days apart.
The training includes scenarios that produced extreme weather—extended hot and cold spells that can lead to deadly heat waves and winter storms. Once trained, the system could examine maps it had not previously seen and make five-day forecasts of extreme weather with 85% accuracy.
With further development, the system could serve as an early warning system for weather forecasters, and as a tool for learning more about the atmospheric conditions that lead to extreme weather, says Pedram Hassanzadeh, an assistant professor of mechanical engineering and of earth, environmental, and planetary sciences at Rice University. Hassanzadeh is a coauthor of a study on the system in the Journal of Advances in Modeling Earth Systems.
Predicting weather patterns
The accuracy of day-to-day weather forecasts has improved steadily since the advent of computer-based numerical weather prediction (NWP) in the 1950s. But even with improved numerical models of the atmosphere and more powerful computers, NWP cannot reliably predict extreme events like the deadly heat waves in France in 2003 and in Russia in 2010.
“It may be that we need faster supercomputers to solve the governing equations of the numerical weather prediction models at higher resolutions,” says Hassanzadeh. “But because we don’t fully understand the physics and precursor conditions of extreme-causing weather patterns, it’s also possible that the equations aren’t fully accurate, and they won’t produce better forecasts, no matter how much computing power we put in.”
In late 2017, Hassanzadeh and study coauthors and graduate students Ashesh Chattopadhyay and Ebrahim Nabizadeh decided to take a different approach.
“When you get these heat waves or cold spells, if you look at the weather map, you are often going to see some weird behavior in the jet stream, abnormal things like large waves or a big high-pressure system that is not moving at all,” Hassanzadeh says.
“It seemed like this was a pattern recognition problem. So we decided to try to reformulate extreme weather forecasting as a pattern-recognition problem rather than a numerical problem.”
Going back to the old ways
Deep learning is a form of artificial intelligence, in which computers are “trained” to make humanlike decisions without being explicitly programmed for them. The mainstay of deep learning, the convolutional neural network, excels at pattern recognition and is the key technology for self-driving cars, facial recognition, speech transcription, and dozens of other advances.
“We decided to train our model by showing it a lot of pressure patterns in the five kilometers [about 3.1 miles] above the Earth, and telling it, for each one, ‘This one didn’t cause extreme weather. This one caused a heat wave in California. This one didn’t cause anything. This one caused a cold spell in the Northeast,'” Hassanzadeh says. “Not anything specific like Houston versus Dallas, but more of a sense of the regional area.”
At the time, Hassanzadeh, Chattopadhyay, and Nabizadeh were barely aware that analog forecasting had once been a mainstay of weather prediction and even had a storied role in the D-Day landings in World War II.
“One way prediction was done before computers is they would look at the pressure system pattern today, and then go to a catalog of previous patterns and compare and try to find an analog, a closely similar pattern,” Hassanzadeh says. “If that one led to rain over France after three days, the forecast would be for rain in France.”
He says one of the advantages of using deep learning is that the neural network didn’t need to be told what to look for.
“It didn’t matter that we don’t fully understand the precursors because the neural network learned to find those connections itself,” Hassanzadeh says. “It learned which patterns were critical for extreme weather, and it used those to find the best analog.”
Testing the AI system
To demonstrate a proof-of-concept, the team used model data taken from realistic computer simulations. The team had reported early results with a convolutional neural network when Chattopadhyay, the lead author of the new study, heard about capsule neural networks. The capsule neural networks were a new form of deep learning that debuted with fanfare in late 2017, in part because it was the brainchild of Geoffrey Hinton, the founding father of convolutional neural network-based deep learning.
Unlike convolutional neural networks, capsule neural networks can recognize relative spatial relationships, which are important in the evolution of weather patterns.
“The relative positions of pressure patterns, the highs and lows you see on weather maps, are the key factor in determining how weather evolves,” Hassanzadeh says.
Another significant advantage of capsule neural networks was that they don’t require as much training data as convolutional neural networks. There’s only about 40 years of high-quality weather data from the satellite era, and Hassanzadeh’s team is working to train its capsule neural network on observational data and compare its forecasts with those of state-of-the-art NWP models.
“Our immediate goal is to extend our forecast lead time to beyond 10 days, where NWP models have weaknesses,” he says.
Though much more work is necessary before the new system can be incorporated into operational forecasting, Hassanzadeh hopes it might eventually improve forecasts for heat waves and other extreme weather.
“We are not suggesting that at the end of the day this is going to replace NWP,” he says. “But this might be a useful guide for NWP. Computationally, this could be a super cheap way to provide some guidance, an early warning, that allows you to focus NWP resources specifically where extreme weather is likely.”
Hassanzadeh says his team is also interested in finding out what patterns the capsule neural network uses to make its predictions.
“We want to leverage ideas from explainable AI (artificial intelligence) to interpret what the neural network is doing,” he says. “This might help us identify the precursors to extreme-causing weather patterns and improve our understanding of their physics.”
Support for the research came from NASA, the National Academies’ Gulf Research Program, and a BP High-Performance Computing Graduate Fellowship from Rice’s Ken Kennedy Institute. The Texas Advanced Computing Center and Pittsburgh Supercomputing Center under the National Science Foundation-supported XSEDE project and Rice’s Center for Research Computing in partnership with the Ken Kennedy Institute provided computing resources for the work.
Source: Rice University
