MYLS Scoring and Results 3 — Questions and Answers
Question 1: When reviewing MYLS score reports, what does a confidence interval (or margin of error) around a score indicate?
- The range of scores the student is likely to achieve if retested under similar conditions (Correct answer)
- The number of questions the student skipped
- The percentage of questions that were marked correctly by the scorer
- The time range within which the student completed the test
Correct answer: The range of scores the student is likely to achieve if retested under similar conditions
A confidence interval shows the range within which a student's true score likely falls, accounting for measurement error.
Question 2: Which factor does NOT directly influence a student's MYLS scaled score?
- The difficulty of the specific test items answered correctly
- The performance of the overall test-taking cohort in that sitting
- The color of the answer sheet used (Correct answer)
- Statistical equating adjustments
Correct answer: The color of the answer sheet used
Physical characteristics of the answer sheet, such as color, have no effect on the psychometric scoring process.
Question 3: A school receives aggregated MYLS data showing that 60% of its Year 7 students are in the two lowest proficiency bands for numeracy. What is the most appropriate school-level response?
- Request that the test be re-scored
- Review and strengthen numeracy instruction and curriculum in lower year levels (Correct answer)
- Inform students their results are invalid
- Switch to a different assessment program immediately
Correct answer: Review and strengthen numeracy instruction and curriculum in lower year levels
Aggregated results signal systemic trends; the appropriate response is to evaluate and improve instructional practices.
Question 4: In MYLS reporting, what does the term 'achievement standard' refer to?
- The minimum score required to pass a subject at school
- A benchmark describing the expected level of skill for students at a given year level (Correct answer)
- The average score of the top 10% of test-takers
- The total number of marks available on the test
Correct answer: A benchmark describing the expected level of skill for students at a given year level
An achievement standard defines what students are expected to know and be able to do at a particular year level.
Question 5: Why might MYLS results from one year not be directly comparable to results from a previous year without statistical adjustment?
- The test is only offered every other year
- Different cohorts and potential changes in test difficulty require equating to ensure comparability (Correct answer)
- Students are not allowed to see their scores from previous years
- The scoring rubric changes entirely each year
Correct answer: Different cohorts and potential changes in test difficulty require equating to ensure comparability
Year-to-year comparisons require equating because cohort composition and test difficulty can vary across administrations.
Question 6: What does it mean if a student's MYLS score is described as 'criterion-referenced'?
- The score is compared only to the top-performing students
- The score describes what specific skills and knowledge the student has demonstrated against set criteria (Correct answer)
- The score is adjusted based on teacher recommendations
- The score reflects speed of completion relative to peers
Correct answer: The score describes what specific skills and knowledge the student has demonstrated against set criteria
Criterion-referenced scores describe what a student can do relative to defined learning criteria, not relative to other students.
Question 7: A student's MYLS literacy score places them at the same proficiency band as most of their classmates, but their numeracy score is two bands higher. What is the correct interpretation for a teacher?
- The student's literacy result is invalid and should be ignored
- The student has numeracy strengths that may benefit from extension or enrichment opportunities (Correct answer)
- The student needs to retake the literacy section immediately
- Both scores are equally unreliable and should not be used
Correct answer: The student has numeracy strengths that may benefit from extension or enrichment opportunities
A notably higher score in one domain suggests that area is a strength and could be nurtured with extension work.
When reviewing MYLS score reports, what does a confidence interval (or margin of error) around a score indicate?