Researchers have shown they can rapidly build intelligent tutoring systems by, in effect, teaching the computer to teach.
Intelligent tutoring systems have been shown to be effective in helping to teach certain subjects, such as algebra or grammar, but creating these computerized systems is difficult and laborious.
Using a new method that employs artificial intelligence, a teacher can teach the computer by demonstrating several ways to solve problems in a topic, such as multicolumn addition, and correcting the computer if it responds incorrectly.
“The only way to get to the full intelligent tutor up to now has been to write these AI rules. But now the system is writing those rules.”
Notably, the computer system learns to not only solve the problems in the ways it was taught, but also to generalize to solve all other problems in the topic, and do so in ways that might differ from those of the teacher, says Daniel Weitekamp III, a PhD student in the Human-Computer Interaction Institute (HCII) at Carnegie Mellon University.
“A student might learn one way to do a problem and that would be sufficient,” Weitekamp explains. “But a tutoring system needs to learn every kind of way to solve a problem.” It needs to learn how to teach problem solving, not just how to solve problems.”
That challenge has been a continuing issue for developers creating AI-based tutoring systems, says Ken Koedinger, professor of human-computer interaction and psychology. Intelligent tutoring systems are designed to continuously track student progress, provide next-step hints, and pick practice problems that help students learn new skills.
When Koedinger and others began building the first intelligent tutors, they programmed production rules by hand—a process, he says, that took about 200 hours of development for each hour of tutored instruction. Later, they would develop a shortcut, in which they would attempt to demonstrate all possible ways of solving a problem. That cut development time to 40 or 50 hours, he notes, but for many topics, it is practically impossible to demonstrate all possible solution paths for all possible problems, which reduces the shortcut’s applicability.
The new method may enable a teacher to create a 30-minute lesson in about 30 minutes, which Koedinger terms “a grand vision” among developers of intelligent tutors.
“The only way to get to the full intelligent tutor up to now has been to write these AI rules,” Koedinger says. “But now the system is writing those rules.”
The new method makes use of a machine learning program that simulates how students learn. Weitekamp developed a teaching interface for this machine learning engine that is user friendly and employs a “show-and-correct” process that’s much easier than programming.
For their new paper, the authors demonstrated their method on the topic of multicolumn addition, but the underlying machine learning engine has been shown to work for a variety of subjects, including equation solving, fraction addition, chemistry, English grammar, and science experiment environments.
The method not only speeds the development of intelligent tutors, but promises to make it possible for teachers, rather than AI programmers, to build their own computerized lessons. Some teachers, for instance, have their own preferences on how to teach addition, or which form of notation to use in chemistry. The new interface could increase the adoption of intelligent tutors by enabling teachers to create the homework assignments they prefer for the AI tutor, Koedinger says.
Enabling teachers to build their own systems also could lead to deeper insights into learning, he adds. The authoring process may help them recognize trouble spots for students that, as experts, they don’t themselves encounter.
“The machine learning system often stumbles in the same places that students do,” Koedinger explains. “As you’re teaching the computer, we can imagine a teacher may get new insights about what’s hard to learn because the machine has trouble learning it.”
A paper describing the method was accepted by the Conference on Human Factors in Computing Systems (CHI 2020), which was scheduled for this month but canceled due to the COVID-19 pandemic. The paper now appears in the conference proceedings in the Association for Computing Machinery’s Digital Library.
The Institute of Education Sciences and Google partially supported the research.
Source: Carnegie Mellon University
