ETS ETS Research and Innovation 2

Question 1

What is the purpose of ETS's 'Cognitive Labs' research methodology?

Accepted Answer

Conducting think-aloud protocols to understand test-taker reasoning

Answer

Cognitive Labs use think-aloud and interview protocols to understand how test takers interpret and respond to items, informing better question design.

Question 2

Which ETS framework describes a comprehensive approach to designing assessments grounded in cognitive theory and evidence?

Accepted Answer

Evidence-Centered Design (ECD)

Answer

Evidence-Centered Design (ECD) is a principled framework developed at ETS that aligns assessment tasks, evidence, and inferences to the construct being measured.

Question 3

ETS researchers contributed significantly to the development of which measurement theory that models each test taker's ability on a continuous scale?

Accepted Answer

Item Response Theory (IRT)

Answer

Item Response Theory (IRT) is central to ETS test development, allowing ability estimation independent of the particular items administered.

Question 4

What is the focus of ETS's Generalizability Theory (G-theory) research?

Accepted Answer

Estimating the generalizability of test scores across different conditions and raters

Answer

G-theory, advanced significantly through ETS research, quantifies how much score variance is attributable to different sources like raters, occasions, and tasks.

Question 5

Which ETS research program focuses specifically on improving assessment for English language learners (ELLs) in K–12 settings?

Accepted Answer

Understanding Language Initiative

Answer

The Understanding Language Initiative, supported by ETS research, focuses on linguistic demands of academic content and assessments for ELL students.

(ETS) Educational Testing Service Practice Test

(ETS) Educational Testing Service Practice Test

ETS ETS Research and Innovation 2