PISA - Program for International Student Assessment Contextual Questionnaire Framework Questions and Answers — Questions and Answers
Question 1: What is the primary purpose of the PISA Contextual Questionnaires that are administered alongside the main cognitive assessments in reading, mathematics, and science?
- To provide context that helps explain differences in student performance. (Correct answer)
- To directly measure students' non-cognitive skills for a separate international ranking.
- To assess the quality of national school curricula.
- To determine the final cognitive assessment score for each student.
Correct answer: To provide context that helps explain differences in student performance.
The main goal of the contextual questionnaires (for students, principals, parents, and teachers) is to gather data on student backgrounds, school environments, and learning attitudes. This information is crucial for analyzing and understanding the results of the cognitive tests, helping to explain why performance varies between students, schools, and countries.
Question 2: The PISA index of economic, social, and cultural status (ESCS) is a critical composite measure derived from the student questionnaire. Which of the following sets of indicators is used to construct this index?
- Student's career aspirations, number of siblings, and weekly allowance.
- Parental income, country of birth, and type of school attended (public vs. private).
- Highest parental occupation, highest parental education, and home possessions. (Correct answer)
- Student's self-reported happiness, classroom size, and availability of school computers.
Correct answer: Highest parental occupation, highest parental education, and home possessions.
The ESCS index is consistently derived from three key variables reported by the student: the highest level of education of their parents (PARED), the highest occupational status of their parents (HISEI), and a list of home possessions which serves as a proxy for family wealth and cultural resources (HOMEPOS).
Question 3: A national education ministry is analyzing its country's PISA results. They use data from the School Principal Questionnaire to investigate the relationship between school autonomy in curriculum and student performance. This scenario is a direct application of which aspect of the Contextual Questionnaire Framework?
- Assessing individual student creativity.
- Monitoring curriculum compliance.
- Informing evidence-based education policy. (Correct answer)
- Evaluating teacher certification programs.
Correct answer: Informing evidence-based education policy.
A key function of the PISA contextual data is to provide policymakers with evidence to inform and guide education policy decisions. By linking school-level factors like autonomy (from the principal questionnaire) to student outcomes (from the cognitive tests), policymakers can investigate which system-level conditions are associated with better performance, thereby informing potential reforms.
Question 4: Which of the following is NOT a standard component of the PISA Contextual Questionnaire Framework?
- Student Questionnaire
- School Principal Questionnaire
- Teacher Peer-Review Form (Correct answer)
- Parent Questionnaire (optional)
Correct answer: Teacher Peer-Review Form
The PISA framework includes questionnaires for students and school principals as standard components. Optional questionnaires for parents and teachers are also part of the framework to gather additional context. However, a formal peer-review form where teachers evaluate each other is not a part of the PISA data collection instruments.
Question 5: The PISA for Development (PISA-D) initiative adapted the standard contextual questionnaires for use in low- and middle-income countries. What was a primary reason for this adaptation?
- To make the questionnaires significantly shorter and easier to administer.
- To better capture the wider range of life experiences and risk factors relevant to students in these contexts. (Correct answer)
- To translate the questionnaires into more languages than the standard PISA.
- To focus exclusively on out-of-school youth and exclude those enrolled in formal education.
Correct answer: To better capture the wider range of life experiences and risk factors relevant to students in these contexts.
The PISA-D initiative enhanced the contextual questionnaires to make them more relevant for developing countries by including a wider range of risk and protective factors and taking into account the different life experiences of children, including those who may be out of school. This allows for a more nuanced understanding of student performance in these specific contexts.
Question 6: Data from the student questionnaire on topics like 'sense of belonging at school' and 'anxiety about mathematics' are primarily used by PISA analysts to:
- Create a global ranking of the happiest students.
- Adjust students' final mathematics scores up or down.
- Diagnose individual students with learning disabilities.
- Investigate relationships between student dispositions and academic achievement. (Correct answer)
Correct answer: Investigate relationships between student dispositions and academic achievement.
The contextual questionnaires gather data on various non-cognitive and metacognitive constructs, such as student attitudes, motivations, and well-being. This information is not used to rank students on these traits or alter their cognitive scores but to conduct research and analysis on how these factors correlate with and potentially influence academic performance in reading, math, and science.
What is the primary purpose of the PISA Contextual Questionnaires that are administered alongside the main cognitive assessments in reading, mathematics, and science?