Undergraduates who know how previous students performed in their university courses end up receiving slightly lower grades on average than they would have if they didn’t check out that information, according to new research.
In a new research paper, researchers examined the effects of a course-planning web application which visualizes data from registrar records and prior student evaluations for each class. Through a randomized field experiment, the scholars found that the use of this platform led on average to a drop of 0.16 units in overall GPA. As an example, that decrease is large enough to move a B+ grade roughly half the distance to a B, the researchers says.
“…providing this type of information in a university environment can have a wide range of effects, some of which are unexpected.”
“The information students rely on to make academic decisions can have a demonstrable effect on their behavior,” says paper coauthor Mitchell Stevens, an associate professor at the Stanford University Graduate School of Education. “The design of academic environments, both digital and physical, really matters for student outcomes in college.”
The lowered scores were especially prominent among freshmen and sophomores, whose GPAs declined by 0.26. Juniors’ and seniors’ GPAs decreased only by 0.09 on average, according to the researchers.
The findings offer some of the first evidence that student behavior and academic performance can be affected by exposure to this type of data, which is more and more common in higher education as a way to help all students have equal access to information about courses and make more knowledgeable decisions about their academic schedules.
“This is a powerful insight for educators, because it suggests that the presentation of currently available institutional information can influence students’ academic behaviors,” the researchers write.
“The main takeaway here is that providing this type of information in a university environment can have a wide range of effects, some of which are unexpected. And we need to understand more about how students use some of this information,” says study coauthor Ramesh Johari, associate professor of management science and engineering.
Info and our actions
Universities and colleges around the country are starting to provide students access to data to help them make decisions about the courses they take.
For this study, the researchers examined the impact of students’ use of Carta, a web-based course-planning tool the researchers developed and made available to students as a voluntary resource to help them plan their courses. The researchers divided students into two groups: those who were encouraged to use Carta and those who weren’t.
The Carta platform provides course information, when available, including the distribution of prior students’ grades, percentage of students who dropped out and withdrew, average rating given by previous student evaluations, and the number of hours per week students reported spending on the course, plus advice from past students to future students considering taking the class.
“What sort of information do students deserve to know? In what form should that information be presented?”
“Universities have a treasure trove of data on what students have done in the past, and this data can help students make better choices,” says René Kizilcec, a researcher at the Graduate School of Education who is joining Cornell University as an assistant professor of information science in July. “One of the big questions is how to present this data so it could guide them rather than lead them astray.”
A concern some educators have expressed about showing students previous grades is that it could lead to students choosing what look like easier courses in order to get higher grades, resulting in grade inflation.
“However, the evidence from the study does not support the conclusion that students change their course portfolio to take easier courses after using Carta,” says lead author Tum Chaturapruek, a computer science doctoral candidate.
The researchers found that seeing prior grades had the biggest impact on GPA. But the researchers also found evidence that showing students solely how much time was spent on the course had a positive effect on GPA.
‘Social jet lag’ can lead to lower grades
“The reality is much more complicated,” Johari says. “Students use this information in different ways, which we are just starting to try to understand.”
What might lead to the grade drop? The researchers found that the shift in GPA was tied to changes in students’ behavior within courses. The researchers hypothesize that the GPA changes are tied to students’ expectations about how hard their courses will be.
“Students start college with a lot of uncertainty about how hard their coursework is going to be. So when they see those grade distributions, which often show that a high percentage of students get A’s, they may invest a little less effort in their coursework,” Stevens offered as a plausible interpretation of the finding. “This is substantiated by the fact that the negative GPA change is strongest for first-year students during their first quarter.”
Making informed choices
The new research paper is the first in a series of studies the researchers are conducting. They also hope to partner with other universities on future studies.
Further research is needed to figure out how the behavior of students changes exactly, the scholars says. In addition, the effects of similar information on student behavior may be different at other universities or colleges.
Study with a strategy to boost grades in college
“This research is already creating many conversations, and there are great questions out there: What sort of information do students deserve to know? In what form should that information be presented?” Stevens says. “We hope to continue to contribute to these discussions and others with further studies.”
The new research paper will be part of the ACM Conference on Learning at Scale at the end of June.
Source: Stanford University
