IKM Software Quality Assurance Methodologies โ Questions and Answers
Question 1: What is the difference between verification and validation?
- Verification tests functionality; validation tests performance
- Verification checks if built correctly; validation checks if correct product is built (Correct answer)
- Verification is manual; validation is automated
- They are identical
Correct answer: Verification checks if built correctly; validation checks if correct product is built
Verification: building it right. Validation: building the right thing.
Verification includes reviews, inspections, and static analysis. Validation includes functional testing, UAT, and beta testing. Both are essential.
Question 2: What is regression testing?
- Testing new features only
- Re-running tests to ensure changes have not broken existing functionality (Correct answer)
- Testing under load
- Testing backward compatibility
Correct answer: Re-running tests to ensure changes have not broken existing functionality
Regression testing re-executes previous tests after changes to verify nothing is broken.
Triggered by code changes or bug fixes. Prime candidate for automation. Strategies include retest-all, selective, and test case prioritization.
Question 3: What is boundary value analysis?
- Testing middle values only
- Testing at edges of input ranges where defects are most likely (Correct answer)
- Testing with random values
- Testing module boundaries
Correct answer: Testing at edges of input ranges where defects are most likely
BVA focuses on testing at and near boundaries where defects commonly cluster.
For range 1-100, test: 0, 1, 2, 99, 100, 101. Based on the observation that errors cluster at boundaries due to off-by-one errors. Complements equivalence partitioning.
Question 4: What is a test case?
- Programming language for tests
- Documented conditions, inputs, and expected results for verifying functionality (Correct answer)
- Automated testing tool
- Post-test report
Correct answer: Documented conditions, inputs, and expected results for verifying functionality
A test case specifies preconditions, inputs, steps, and expected results.
Includes ID, title, preconditions, steps, test data, expected/actual results, and pass/fail. Should be independent, repeatable, and traceable to requirements.
Question 5: What is code coverage analysis?
- Measuring code speed
- Measuring what percentage of code is exercised by tests (Correct answer)
- Detecting vulnerabilities
- Optimizing compilation
Correct answer: Measuring what percentage of code is exercised by tests
Code coverage measures the percentage of code executed during testing.
Types: statement, branch, condition, path, function coverage. 100% coverage does not guarantee correctness. 80% is a common target. Tools: JaCoCo, Istanbul, coverage.py.
Question 6: What is exploratory testing?
- Script-based testing
- Simultaneous test design, execution, and learning (Correct answer)
- Production-only testing
- End user testing
Correct answer: Simultaneous test design, execution, and learning
Exploratory testing simultaneously designs and executes tests using creativity and domain knowledge.
Time-boxed sessions (60-90 min) with a charter. Effective for finding usability issues and edge cases that scripted tests miss. Session-based test management provides structure.
Question 7: What is continuous testing in DevOps?
- Testing only at the end
- Automated testing at every pipeline stage for rapid feedback (Correct answer)
- Manual testing during business hours
- Testing only in staging
Correct answer: Automated testing at every pipeline stage for rapid feedback
Continuous testing integrates automated tests throughout the CI/CD pipeline.
Follows the test pyramid: many unit tests, fewer integration tests, fewest E2E tests. Shift-left moves testing earlier; shift-right adds production monitoring.
Question 8: What is the difference between black-box and white-box testing?
- Black-box tests security
- Black-box tests without code knowledge; white-box tests with full code knowledge (Correct answer)
- Black-box is automated
- Black-box tests UI only
Correct answer: Black-box tests without code knowledge; white-box tests with full code knowledge
Black-box tests functionality without seeing code; white-box examines internal logic.
Black-box techniques: equivalence partitioning, BVA, decision tables. White-box: statement/branch/path coverage. Gray-box combines partial knowledge. Use both together.
Question 9: What is a defect life cycle?
- Time between releases
- Stages a bug goes through from discovery to closure (Correct answer)
- Lifespan of test scripts
- Feature deprecation timeline
Correct answer: Stages a bug goes through from discovery to closure
The defect life cycle tracks a bug through stages: New, Assigned, Open, Fixed, Verified, Closed.
Additional states: Deferred, Rejected, Duplicate, Reopened. Key attributes: severity, priority, reproducibility, environment. Metrics include density, leakage, aging.
Question 10: What are the main types of performance testing?
- UI consistency testing
- Load, stress, endurance, and spike testing (Correct answer)
- Data accuracy testing
- Cross-browser testing
Correct answer: Load, stress, endurance, and spike testing
Performance testing includes load, stress, endurance, and spike testing under various conditions.
Load: expected load. Stress: beyond limits. Endurance: sustained load for leaks. Spike: sudden increases. Tools: JMeter, Gatling, k6. Metrics: response time, throughput, error rate.
Question 11: What is test-driven development (TDD)?
- Tests after code
- Write tests before code, then implement to pass (Correct answer)
- Testers drive development
- Testing in dev environment
Correct answer: Write tests before code, then implement to pass
TDD follows Red-Green-Refactor: failing test, minimum code to pass, then improve.
Benefits: better design, living documentation, confidence to refactor. BDD extends TDD with Given/When/Then syntax. Works best with unit tests.
Question 12: What is a test automation framework?
- Replaces manual testers
- Structured approach with reusable components for automated tests (Correct answer)
- Random data generator
- Manual test documentation
Correct answer: Structured approach with reusable components for automated tests
A framework provides guidelines, standards, and reusable libraries for automated testing.
Types: data-driven, keyword-driven, page object model, BDD (Cucumber). Handles test data, reporting, logging, error handling. Popular: Selenium, Playwright, Cypress.
Question 13: In the V-Model, which test level is planned directly from the requirements analysis phase?
- Unit testing
- Integration testing
- System testing
- Acceptance testing (Correct answer)
Correct answer: Acceptance testing
The V-Model pairs requirements analysis with acceptance testing, which validates that the delivered system meets user needs.
Question 14: What is the primary purpose of mutation testing?
- To evaluate the effectiveness of a test suite by injecting small code faults (Correct answer)
- To generate random input data for load tests
- To verify database schema migrations
- To measure code complexity metrics
Correct answer: To evaluate the effectiveness of a test suite by injecting small code faults
Mutation testing seeds small changes (mutants) into code and checks whether existing tests detect, or 'kill', them.
Question 15: A tester needs to cover every combination of values for each pair of input parameters while minimizing test count. Which technique fits best?
- Boundary value analysis
- Pairwise (all-pairs) testing (Correct answer)
- Decision table testing
- State transition testing
Correct answer: Pairwise (all-pairs) testing
Pairwise testing guarantees all two-way parameter combinations are covered with far fewer cases than exhaustive testing.
Question 16: At which CMMI maturity level are processes controlled using statistical and quantitative techniques?
- Level 2 - Managed
- Level 3 - Defined
- Level 4 - Quantitatively Managed (Correct answer)
- Level 5 - Optimizing
Correct answer: Level 4 - Quantitatively Managed
CMMI Level 4 introduces quantitative objectives and statistical control of process performance.
Question 17: How is Defect Removal Efficiency (DRE) typically calculated?
- Defects found after release divided by total test cases
- Defects found before release divided by total defects (before plus after release) (Correct answer)
- Total defects divided by lines of code
- Fixed defects divided by reopened defects
Correct answer: Defects found before release divided by total defects (before plus after release)
DRE measures the share of all defects caught before delivery, so a higher percentage means more effective QA.
Question 18: Which model is specifically designed to assess and improve an organization's test process maturity?
- ITIL
- TMMi (Correct answer)
- COBIT
- PMBOK
Correct answer: TMMi
TMMi (Test Maturity Model integration) is a five-level framework for test process improvement that complements CMMI.
Question 19: In a formal Fagan inspection, who is responsible for leading the meeting and ensuring the process is followed?
- The author
- The reader
- The scribe
- The moderator (Correct answer)
Correct answer: The moderator
The moderator plans and facilitates the inspection and ensures follow-up on found defects.