Different Question Types Can Impact Students' Exam Predictions

Different Question Types Can Impact Students' Exam Predictions


What is this Research About?

Instructors can choose to use several different types of questions on exams, some more open-ended than others (e.g., true-false, multiple choice, fill in the blank, short and long answers, etc.). Students’ ability to predict or analyze their performance on exams can vary depending upon which format of questions are used. In this study, the researcher investigated how true-false, multiple-choice, and fill-in-the-blank questions affect students’ ability to predict their exam scores. The researcher applied Koriat’s (1997) idea that students use different clues from each question type to make these predictions. The study also considered the ease of predicting and postdicting correctly for each type of question. The goal was to find out which question types helped students make the most accurate predictions about their exam performance. 

What did the Researchers Do?

The researcher asked students in an undergraduate psychology course to predict and postdict their performance on three types of questions—true-false, multiple-choice, and fill-in-the-blank—across three exams. Students made predictions about their performance before taking the exams and postdicted their performance afterward. The study measured how accurate these predictions and reviews were by using two different methods: bias scores (measuring the difference between what students predicted their scores will be and their actual scores) and gamma correlations (measuring how well students' predictions and reviews matched their actual performance, showing the strength and direction of this relationship). 

What did the Researchers Find?

The accuracy of students’ predictions of their exam scores varied across different question types. When looking at bias scores, students’ predictions and reviews were most accurate for multiple-choice questions. Students predicted the lowest scores for fill-in-the-blank questions. However, when using gamma correlations, students’ predictions remained most accurate for multiple-choice questions, but their reviews were most accurate for fill-in-the-blank questions. The results indicate that different question types can affect how accurately students are able to predict and postdict their exam performance, at least in relation to course content. 

→ How to Implement this Research in Your Classroom

Using a mix of question types can support different metacognitive skills, helping students evaluate their learning more effectively. Multiple-choice questions might help students better predict and postdict their performance, while fill-in-the-blank questions could improve their post-exam reflections. Instructors should think about how question types can influence students' self-assessment skills when analyzing their expected performance on exams.  

→  Citation

McGuire, M. J. (2023). Question format biases college students' metacognitive judgments for exam performance. International Journal for the Scholarship of Teaching and Learning, 17(1), Article 15. https://doi.org/10.20429/ijsotl.2023.17115  

→  Keywords

  • Student Predictions
  • Exam Performance
  • Question Types
  • Self-Assessment
  • Metacognition
  • Learning Strategies 

Creative Commons by logo This work is licensed under the Creative Commons Attribution 2.0 Canada License


Snapshot Writer: Sakhi Sanghvi

Snapshot Publication Date: 2024


Contact Us

 

E-mail the Office of Teaching and Learning (otl@uoguelph.ca) with any questions related to your teaching and learning needs.