WeBWork Quality Assurance and Improvement 2

Question 1

In WeBWorK quality assurance, which metric best measures whether a problem set's difficulty is appropriately calibrated?

Accepted Answer

Average score across all students

Answer

Average score across all students directly reflects whether the problem set difficulty is appropriately calibrated for the target population.

Question 2

When a WeBWorK problem returns an error for a specific student input but not others, what is the most likely cause?

Accepted Answer

Unhandled edge case in the problem code

Answer

Errors triggered by specific inputs typically indicate unhandled edge cases in the problem's Perl code, such as division by zero or invalid domain values.

Question 3

Which WeBWorK feature allows instructors to test a problem with randomized seeds before publishing it to students?

Accepted Answer

Problem Editor preview

Answer

The Problem Editor's preview feature lets instructors render a problem with any seed to check randomized variants before assigning them.

Question 4

An instructor notices students consistently answer a true/false WeBWorK problem correctly on the first try at a 95% rate. What QA concern does this raise?

Accepted Answer

The problem may be too easy or non-discriminating

Answer

A near-perfect first-attempt rate suggests the problem may be trivial or guessable, making it a poor discriminator of student understanding.

Question 5

What is the purpose of the 'showMeAnother' feature in WeBWorK from a QA perspective?

Accepted Answer

To regenerate a problem with a new random seed for practice

Answer

ShowMeAnother regenerates the problem with a new seed so students can practice the same concept with different values, which also helps QA teams verify multiple randomization variants.

WeBWork Practice Test

WeBWork Practice Test

WeBWork Quality Assurance and Improvement 2