Improving the Quality of Machine-Gradable Questions

Credit: iStock.com/Radila Radilova
Credit: iStock.com/Radila Radilova
Tests provide one measure of our students’ learning according to the standards of the instructor and the field. But tests also affect our students socially, emotionally, and financially and influence their science-minded identities for years to come. We owe it to students to create fair tests with transparent expectations, clear guidelines for studying, and questions that adhere to scholarly practices. Our goal at the 2020 Teaching Professor Conference was to provide a road map to improving the quality of the machine gradable test items. We emphasized crafting and aligning learning objectives with test items and provided an item-writing checklist to help instructors critique and improve their test items.

To continue reading, you must be a Teaching Professor Subscriber. Please log in or sign up for full access.

One Response

  1. I particularly appreciated your comments that, “They should construct tests that minimize excessive or unnecessary reading.” This is an issue whenever a new textbook is adopted. I noticed a test quality challenge recently when my department made the well-meaning leap to an open source textbook. While the new content was as good as the old, the old test bank did not match. Each author used a slightly different voice to describe even basic concepts. If multiple choice quiz questions don’t match in voice, wording, or definitions, this can unfairly confuse students and drive them to “Google” the answers. This is a serious problem with online teaching. Students who have done the required reading deserve quiz questions that test concepts using the same wording. In fairness to students, whenever a new textbook is adopted, a new test bank should be written to match.

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Related Articles

I have two loves: teaching and learning. Although I love them for different reasons, I’ve been passionate about...
Recently, a student sent me a political news article with the comment “Things are falling apart.” I didn’t...
You’ve prepared a fabulous, interactive class. You’ve designed engaging activities, developed meaningful discussion questions, and cultivated an inviting...
AI has become a part of nearly all facets of teaching, from lesson development to exam creation to...
Navigating the gulf between the most and least prepared students in a course can seem like an insurmountable...
I’ve taught a course in statistics for psychological research for almost 40 years. No student becomes a psych...
My course is literally about teaching reading to young children, a challenge given that research suggests that college...

Create a free account, or log in.

Gain access to limited free articles, news alerts, and select newsletters

Login here

Get unlimited access to The Teaching Professor

Stay informed. Subscribe Now.

WELCOME OFFER

$19.00 $14.00/month

for your first 6 months. Use coupon code TP6MO.

$19.00 thereafter. Cancel anytime.

Enjoy unlimited access to all of The Teaching Professor

You only have  free article views remaining.

WELCOME OFFER

$19.00 $14.00/month

for your first 6 months. Use coupon code TP6MO.

$19.00 a month thereafter. Cancel anytime.

Are you signed up for free weekly Teaching Professor updates?

You'll get notified of the newest articles.