ORELA Assessment & Evaluation Techniques 2

Question 1

A teacher notices that students from one demographic group consistently score lower on a multiple-choice test than on performance tasks measuring the same skills. This discrepancy most likely indicates:

Accepted Answer

Construct irrelevant variance due to cultural or linguistic bias in the test items

Answer

When scores differ by group on the same construct, construct irrelevant variance—often from biased item language or cultural assumptions—is the most likely culprit.

Question 2

Which of the following best describes the purpose of an item analysis after administering a classroom test?

Accepted Answer

To identify individual items that may be flawed or that discriminate poorly between high and low performers

Answer

Item analysis examines difficulty indices and discrimination indices to flag items that may be misleading, too easy, too hard, or failing to differentiate student understanding.

Question 3

A district uses the same reading assessment each fall for three consecutive years to track cohort growth. What threat to validity should the assessment team be most concerned about?

Accepted Answer

Practice effects and item exposure reducing the assessment's construct validity over time

Answer

Repeated use of identical items allows students to benefit from prior exposure, threatening validity because scores may reflect familiarity rather than growth in the target skill.

Question 4

In standards-based grading, a student's final grade should primarily reflect:

Accepted Answer

The most consistent and recent evidence of mastery of learning targets

Answer

Standards-based grading emphasizes reporting the level of mastery a student has demonstrated, prioritizing recent and consistent evidence over early or isolated scores.

Question 5

Which assessment approach is MOST appropriate when the goal is to evaluate a student's ability to apply knowledge to novel, real-world problems?

Accepted Answer

Authentic performance tasks requiring demonstration of competencies

Answer

Authentic performance tasks require students to apply skills in realistic contexts, making them the most appropriate format for assessing transfer and application.

(ORELA) Oregon Educator Licensure Assessments Practice Test

(ORELA) Oregon Educator Licensure Assessments Practice Test

ORELA Assessment & Evaluation Techniques 2