MTS Evaluation 3

Question 1

Which type of reliability is assessed by administering the same test to the same group on two separate occasions?

Accepted Answer

Test-retest reliability

Answer

Test-retest reliability measures the consistency of results when the same instrument is administered twice to the same group.

Question 2

A training evaluation reveals that the skills gap has been eliminated but employee turnover has increased. At which Kirkpatrick level should the MTS investigate further?

Accepted Answer

Level 4

Answer

Level 4 (Results) examines organizational outcomes like turnover, productivity, and ROI, which may be affected by factors beyond training.

Question 3

What is the main advantage of using anonymous surveys in Level 1 reaction evaluations?

Accepted Answer

They encourage more honest and candid feedback

Answer

Anonymity reduces social desirability bias and encourages learners to provide candid, honest reactions to the training.

Question 4

Which approach involves evaluating training while it is still being developed and delivered for the first time?

Accepted Answer

Formative evaluation

Answer

Formative evaluation is conducted during development or early delivery to identify and correct problems before full implementation.

Question 5

An evaluator uses a rubric to score role-play performance. What type of validity evidence does a well-designed rubric primarily support?

Accepted Answer

Content validity

Answer

A rubric aligned with the job task content provides content validity evidence that the assessment covers the relevant domain.

(MTS) Master Training Specialist Practice Test

(MTS) Master Training Specialist Practice Test

MTS Evaluation 3