Selenium Testing Framework Regulatory Frameworks & Compliance 3 — Questions and Answers
Question 1: When integrating Selenium tests into a CI/CD pipeline for a regulated financial application, which practice satisfies change management compliance?
- Gate deployments on a passing test suite run with stored, versioned test results (Correct answer)
- Run tests only in production to catch real issues
- Allow developers to bypass test failures with manual approval
- Delete test reports after 7 days to save storage
Correct answer: Gate deployments on a passing test suite run with stored, versioned test results
Change management frameworks like ITIL require evidence of testing before deployment; versioned, passing test results provide that audit-ready evidence.
Question 2: Which Selenium pattern best supports compliance with the EU Accessibility Act (EAA) deadline requirements for private sector websites?
- Automated accessibility regression testing in CI to prevent new violations from shipping (Correct answer)
- One-time accessibility audit run before launch
- Manual screen reader testing on a quarterly basis
- Disabling JavaScript to test baseline content access
Correct answer: Automated accessibility regression testing in CI to prevent new violations from shipping
The EAA requires ongoing accessibility compliance, so continuous automated regression testing in CI ensures new code doesn't introduce violations.
Question 3: Under NIST SP 800-53 controls, how should Selenium test credentials be managed in a government system test suite?
- Retrieved at runtime from a secrets manager, never hardcoded in test scripts (Correct answer)
- Stored in a plain text config file excluded from version control
- Embedded in the test class as static final Strings
- Passed as command-line arguments visible in process listings
Correct answer: Retrieved at runtime from a secrets manager, never hardcoded in test scripts
NIST SP 800-53 IA controls require protection of authenticators; secrets managers provide runtime injection without exposing credentials in code or logs.
Question 4: A Selenium framework must support FedRAMP authorization for a cloud-hosted test environment. Which configuration is required?
- Tests must run within FedRAMP-authorized infrastructure and test data must not leave that boundary (Correct answer)
- Tests can run on any public cloud as long as results are encrypted
- Developer laptops are acceptable test execution environments
- Only the production environment needs FedRAMP authorization
Correct answer: Tests must run within FedRAMP-authorized infrastructure and test data must not leave that boundary
FedRAMP requires that all components handling federal data, including test execution environments, operate within authorized boundaries.
Question 5: Which Selenium test validates that a website complies with ADA Title III requirements regarding accessible error messages?
- Submit an invalid form and assert the error message is associated with its field via aria-describedby (Correct answer)
- Verify form fields have placeholder text
- Check that error messages appear in red text
- Assert the form has a submit button with type='submit'
Correct answer: Submit an invalid form and assert the error message is associated with its field via aria-describedby
ADA-compliant error handling requires programmatic association between errors and their fields, which aria-describedby provides for assistive technology users.
Question 6: Under ISO/IEC 25010 quality standards, which Selenium metric most directly measures the 'reliability' characteristic?
- Test pass rate across multiple execution runs under varied conditions (Correct answer)
- Total number of test cases in the suite
- Average page load time captured during tests
- Code coverage percentage of the application under test
Correct answer: Test pass rate across multiple execution runs under varied conditions
ISO/IEC 25010 defines reliability as the ability to perform under specified conditions; a stable pass rate across multiple environments measures this directly.
Question 7: When Selenium test results are used as compliance evidence for an FDA 21 CFR Part 11 audit, which requirement is most critical?
- Test records must include a verifiable electronic signature and be tamper-evident (Correct answer)
- Tests must be written in Java
- Test execution must be completed within 24 hours of a release
- Screenshots must be captured for every test step
Correct answer: Test records must include a verifiable electronic signature and be tamper-evident
FDA 21 CFR Part 11 governs electronic records in regulated industries and mandates that records be attributable, tamper-evident, and signed to ensure integrity.
Selenium Testing Framework Regulatory Frameworks & Compliance 3
When integrating Selenium tests into a CI/CD pipeline for a regulated financial application, which practice satisfies change management compliance?