Psychometric Properties Flashcards

An organization administers the SPI to a group of employees. Two weeks later, they administer the same test to the same group to evaluate the consistency of the scores. This procedure is primarily designed to assess which psychometric property?

Answer: Test-Retest Reliability

Test-retest reliability measures the stability of a test over time. By administering the same test to the same individuals on two different occasions and correlating the scores, one can determine how consistent the results are. A high correlation indicates good test-retest reliability.

A company uses the SPI as a pre-employment screening tool for a sales role. After one year, they find a strong positive correlation between high scores on the 'Ambition' scale and actual sales performance. This finding provides direct evidence for the scale's:

Answer: Predictive Validity

Predictive validity, a form of criterion-related validity, is demonstrated when scores from an assessment accurately forecast future outcomes. In this scenario, the SPI's 'Ambition' score is predicting the future outcome of job performance (sales figures).

Which of the following statistics is most commonly used to evaluate the internal consistency of a personality scale within the SPI, indicating how well the items on the scale measure a single, unified concept?

Answer: Cronbach's Alpha (α)

Cronbach's Alpha is a measure of internal consistency, or how closely related a set of items are as a group. It is considered to be a measure of scale reliability. A high alpha value suggests that the items on a scale (e.g., all the items for Extraversion) are measuring the same underlying construct.

To establish the construct validity of the SPI's 'Sociability' scale, a research team administers it to a group along with another well-established test known to measure 'Gregariousness'. They find a high positive correlation between the two scales. This provides what specific type of validity evidence?

Answer: Convergent evidence

Convergent validity is a subtype of construct validity. It is demonstrated when a measure correlates highly with other measures that it theoretically should be related to. Since 'Sociability' and 'Gregariousness' are very similar constructs, a high correlation between the two scales provides strong convergent evidence.

During the initial development phase of the SPI, a panel of subject matter experts (SMEs) in personality psychology carefully reviews all proposed test questions. They are asked to rate each question on its relevance and representativeness of the specific personality facet it is intended to measure. This entire process is a critical step for establishing:

Answer: Content Validity

Content validity refers to the extent to which a test's items are representative of the entire domain the test seeks to measure. Using a panel of SMEs to review items for relevance and comprehensiveness is the primary method for establishing strong content validity.

What is the fundamental relationship between a personality scale's reliability and its Standard Error of Measurement (SEM)?

Answer: As reliability increases, the SEM decreases.

The Standard Error of Measurement (SEM) represents the amount of error in an individual's test score. Reliability is the consistency of a measure. These two concepts have an inverse relationship: the more reliable (consistent) a test is, the smaller the amount of measurement error (SEM) will be. A perfectly reliable test would have an SEM of zero.