MTS Assessment & Evaluation Design 3

Question 1

Which statistical measure indicates how closely test scores cluster around the mean, reflecting precision of the assessment?

Accepted Answer

Standard deviation

Answer

Standard deviation measures the spread of scores around the mean; a smaller standard deviation indicates scores are more tightly clustered and the test is more precise.

Question 2

When constructing a multiple-choice item, which practice most directly reduces construct-irrelevant variance?

Accepted Answer

Ensuring all distractors are plausible but clearly incorrect

Answer

Plausible distractors ensure the item measures the target knowledge rather than test-taking savvy or reading comprehension of implausible options.

Question 3

In the Phillips ROI Methodology, Level 5 requires converting training benefits to monetary value and comparing them to program costs. What is the formula for ROI?

Accepted Answer

((Benefits − Costs) / Costs) × 100

Answer

ROI (%) = ((Net Benefits − Program Costs) / Program Costs) × 100, showing the return for every dollar invested.

Question 4

A formative evaluation conducted mid-course is primarily intended to:

Accepted Answer

Identify instructional problems and make real-time improvements

Answer

Formative evaluation occurs during development or delivery to identify weaknesses and guide continuous improvement before final deployment.

Question 5

Which data collection method is most appropriate when the evaluator needs to observe subtle interpersonal dynamics during a leadership simulation?

Accepted Answer

Structured behavioral observation checklist

Answer

A structured behavioral observation checklist allows trained raters to systematically capture specific behaviors as they occur in real time.

(MTS) Master Training Specialist Practice Test

(MTS) Master Training Specialist Practice Test

MTS Assessment & Evaluation Design 3