Assessment & Evaluation Methods Flashcards

In an assessment, what does 'reliability' refer to?

Answer: Consistency of results across administrations and examiners

A reliable exam produces consistent scores when the same competence is measured repeatedly or by different examiners.

Why do practical examiners use a standardized scoring checklist?

Answer: To keep scoring objective and consistent among candidates

Standardized checklists reduce examiner bias and make scoring consistent for every candidate.

An operator certified on a lattice boom crawler is assigned to a telescopic boom truck crane. What should the employer do first?

Answer: Confirm certification/evaluation covers that crane type and configuration

Certification is by type and capacity, and the employer's evaluation must cover the equipment actually used.

What is the main purpose of having a proctor during an NCCER written assessment?

Answer: To keep test conditions secure and standardized

Proctors keep the exam secure and run it under uniform conditions so results are valid.

A candidate passes the written exam but fails the practical exam. What is the typical result?

Answer: The candidate is not certified until the practical exam is passed

Certification requires passing both parts, so a failed practical must be retaken and passed.

Which situation would most likely call for re-evaluating an operator even though their certification has not expired?

Answer: Observed unsafe operation or a near-miss caused by the operator

Unsafe performance shows a possible skill gap, so the employer should retrain and re-evaluate before assigning more lifts.

What does 'content validity' mean for a crane written exam?

Answer: The questions accurately represent the knowledge the job requires

Content validity means the test items match the knowledge domains needed for safe crane operation.