PISA PISA Digital Literacy and Computer-Based Assessment 2 — Questions and Answers
Question 1: What does PISA's 'collaborative problem-solving' framework, assessed in 2015, measure in a computer-based context?
- Students' ability to work with virtual agents to solve shared tasks (Correct answer)
- Students' ability to code in pairs
- Students' network security knowledge
- Students' ability to build spreadsheets collaboratively
Correct answer: Students' ability to work with virtual agents to solve shared tasks
PISA 2015 collaborative problem-solving measured how well students worked with simulated virtual agents to reach a common solution.
Question 2: How does PISA's computer-based platform record student behavior beyond final answers?
- It does not record process data
- It captures log files of click sequences, time-on-task, and navigation paths (Correct answer)
- It records video of students
- It tracks eye movement only
Correct answer: It captures log files of click sequences, time-on-task, and navigation paths
PISA's computer-based system logs process data including click sequences, time-on-task, and navigation choices, enabling analysis of problem-solving strategies.
Question 3: In PISA computer-based reading tasks, what does 'multiple-source integration' require students to do?
- Read one long passage carefully
- Synthesize information across several digital documents to answer a question (Correct answer)
- Identify grammatical errors in emails
- Translate texts between languages
Correct answer: Synthesize information across several digital documents to answer a question
Multiple-source integration tasks require students to synthesize and compare information from two or more digital documents to construct an answer.
Question 4: Which organization manages the technical delivery platform for PISA's computer-based assessments?
- UNESCO
- OECD with contracted vendors (Correct answer)
- The World Bank
- ETS independently
Correct answer: OECD with contracted vendors
The OECD oversees PISA and works with contracted technology vendors to develop and manage the computer-based delivery platform across all countries.
Question 5: What is one key advantage of computer-based delivery cited by PISA for adaptive testing designs?
- It eliminates the need for scoring rubrics
- It allows item difficulty to adjust based on student responses, improving measurement precision (Correct answer)
- It removes the need for trained test administrators
- It makes all items multiple-choice
Correct answer: It allows item difficulty to adjust based on student responses, improving measurement precision
Computer-based delivery enables adaptive testing where item difficulty adjusts in real time to each student's performance, increasing measurement accuracy across ability levels.
Question 6: Which PISA 2022 component specifically required students to use a simulated digital interface to solve mathematical tasks?
- The financial literacy supplement
- The creative thinking innovative domain
- The computer-based mathematical literacy units (Correct answer)
- The global competence questionnaire
Correct answer: The computer-based mathematical literacy units
PISA 2022 mathematical literacy was delivered primarily via computer-based units that required students to interact with digital tools and simulated interfaces.
PISA PISA Digital Literacy and Computer-Based Assessment 2
What does PISA's 'collaborative problem-solving' framework, assessed in 2015, measure in a computer-based context?