TS Test Execution & Data Collection 2 — Questions and Answers
Question 1: A tester notices that a defect found during regression testing was already fixed in a previous release but has reappeared. What type of defect is this?
- Latent defect
- Regression defect (Correct answer)
- Blocking defect
- Severity-1 defect
Correct answer: Regression defect
A regression defect is one that was previously fixed but reappears in a later build or release.
Question 2: During test execution, which metric best indicates the completeness of the test run at a given point in time?
- Defect density
- Test execution progress (% executed) (Correct answer)
- Mean time to failure
- Code coverage percentage
Correct answer: Test execution progress (% executed)
Test execution progress (percentage of planned tests executed) directly measures how much of the test suite has been run.
Question 3: A test team uses a keyword-driven testing framework. What is stored in the test data tables that drives the automation?
- Compiled scripts
- Keywords representing actions and associated test data (Correct answer)
- Source code modules
- Database schema definitions
Correct answer: Keywords representing actions and associated test data
In keyword-driven frameworks, tables contain keywords (action words) mapped to specific operations and the data needed to execute them.
Question 4: Which of the following best describes a 'test incident' as defined in IEEE 829?
- A planned test scenario that has not yet been executed
- Any event occurring during testing that requires investigation (Correct answer)
- A defect that has been confirmed by the development team
- A failed test case with a documented workaround
Correct answer: Any event occurring during testing that requires investigation
IEEE 829 defines a test incident as any event during testing that requires further investigation, regardless of whether it is actually a defect.
Question 5: When executing exploratory tests, what is the primary artifact a tester produces to record findings?
- Formal test case script
- Session charter with notes and observations (Correct answer)
- Automated test log
- Requirements traceability matrix
Correct answer: Session charter with notes and observations
In exploratory testing, testers document their session charter, goals, findings, and observations rather than following pre-scripted steps.
Question 6: A CI/CD pipeline runs automated tests on every commit. A test that sometimes passes and sometimes fails without any code change is called what?
- Regression test
- Flaky test (Correct answer)
- Smoke test
- Performance test
Correct answer: Flaky test
A flaky test produces inconsistent results on the same code, undermining trust in the test suite and requiring investigation.
Question 7: During data collection, a tester records the time between when a defect is logged and when it is resolved. What metric does this represent?
- Defect removal efficiency
- Mean time to repair (MTTR) (Correct answer)
- Defect detection rate
- Defect severity index
Correct answer: Mean time to repair (MTTR)
Mean Time to Repair (MTTR) measures the average time taken to fix a defect from the moment it is reported.
A tester notices that a defect found during regression testing was already fixed in a previous release but has reappeared.
What type of defect is this?