ATP ATP Psychometrics & Score Interpretation

Question 1

What does 'reliability' mean in the context of educational and psychological testing?

Accepted Answer

The consistency of test scores across repeated administrations or parallel forms

Answer

Whether the test measures the right content

Answer

The speed of test delivery

Answer

The number of items in a test

Question 2

What is 'Cronbach's alpha' used to measure?

Accepted Answer

Internal consistency reliability of a test

Answer

The average score of all examinees

Answer

The correlation between two different tests

Answer

The standard error of measurement

Question 3

What is the 'standard error of measurement' (SEM)?

Accepted Answer

An estimate of the variability in a test score due to measurement error

Answer

The average number of mistakes made by test administrators

Answer

The standard deviation of all test scores

Answer

The error rate in test printing

Question 4

What is a 'norm-referenced' test?

Accepted Answer

A test where scores are interpreted relative to the performance of a comparison group

Answer

A test that measures mastery of specific content standards

Answer

A test that all examinees must pass

Answer

A test administered under normal conditions only

Question 5

What does a 'criterion-referenced' test measure?

Accepted Answer

Whether an examinee has mastered a defined set of skills or knowledge

Answer

Performance relative to peers

Answer

The average performance across demographic groups

Answer

The financial cost to develop the test

Question 6

What is a 'percentile rank'?

Accepted Answer

The percentage of scores in a distribution that fall at or below a given score

Answer

The raw score divided by the number of items

Answer

The ranking of test items by difficulty

Answer

The percentage of items answered correctly