EDC Quality Assurance & Compliance 3 — Questions and Answers
Question 1: In assessment quality assurance, 'interrater reliability' refers to:
- Consistency of scores across different test occasions
- Agreement between two or more evaluators scoring the same student (Correct answer)
- The test measuring what it claims to measure
- The accuracy of norm-referenced score comparisons
Correct answer: Agreement between two or more evaluators scoring the same student
Interrater reliability measures the degree of agreement between different evaluators scoring the same response or performance.
Question 2: A diagnostician uses a norm-referenced test standardized on a national sample that does not reflect the student's cultural background. This MOST directly raises concerns about:
- Test-retest reliability
- Content validity
- Cultural bias and construct validity (Correct answer)
- Standard error of measurement
Correct answer: Cultural bias and construct validity
Using norms from non-representative populations can introduce cultural bias, undermining the construct validity of scores for students from underrepresented groups.
Question 3: The NASP (National Association of School Psychologists) ethical standard requiring diagnosticians to only use assessments within their training reflects which ethical principle?
- Beneficence
- Competence (Correct answer)
- Nonmaleficence
- Justice
Correct answer: Competence
Competence requires practitioners to use only assessments and techniques for which they have adequate training, supervision, or experience.
Question 4: A diagnostician wants to document that an assessment battery comprehensively samples the skill domain being evaluated. This is an argument for which type of validity?
- Criterion-related validity
- Content validity (Correct answer)
- Construct validity
- Predictive validity
Correct answer: Content validity
Content validity evaluates whether assessment items adequately and representatively sample the full domain of the construct being measured.
Question 5: Which statistical index is typically used to report how much measurement error exists in a test score, helping diagnosticians form confidence intervals?
- Cronbach's alpha
- Standard error of measurement (SEM) (Correct answer)
- Effect size (Cohen's d)
- Pearson correlation coefficient
Correct answer: Standard error of measurement (SEM)
The standard error of measurement quantifies score variability due to measurement error and is used to construct confidence intervals around obtained scores.
Question 6: Under IDEA's non-discriminatory evaluation requirements, assessments must be:
- Administered only in English to ensure standardization
- Provided in the child's native language or other mode of communication where feasible (Correct answer)
- Limited to standardized norm-referenced instruments only
- Conducted exclusively by licensed psychologists
Correct answer: Provided in the child's native language or other mode of communication where feasible
IDEA §300.304 requires evaluations to be provided and administered in the child's native language or mode of communication unless it is clearly not feasible.
Question 7: When a diagnostician reviews cumulative records as part of an evaluation, which FERPA right allows parents of minor students to inspect these records?
- Right to financial aid records
- Right to inspect and review education records (Correct answer)
- Right to request criminal background checks
- Right to demand teacher performance records
Correct answer: Right to inspect and review education records
FERPA grants parents of minor students the right to inspect and review their child's education records maintained by the school.
EDC Quality Assurance & Compliance 3
In assessment quality assurance, 'interrater reliability' refers to: