Cloud Engineer Research & Evidence-Based Practice 4 — Questions and Answers
Question 1: A cloud team wants to evaluate the security posture of their infrastructure. Which evidence source provides the most objective, standardized baseline?
- Internal team self-assessments
- CIS Benchmarks or NIST frameworks applied via automated compliance scanning tools (Correct answer)
- Vendor security certification documentation
- Informal peer review from another team
Correct answer: CIS Benchmarks or NIST frameworks applied via automated compliance scanning tools
CIS Benchmarks and NIST frameworks are independently developed standards, and automated scanning provides objective, repeatable measurement against them.
Question 2: What is the primary purpose of an A/B test in a cloud platform engineering context?
- To compare two cloud providers for the same workload
- To isolate the causal effect of a single change by exposing different populations to each variant simultaneously (Correct answer)
- To test production and staging environments in parallel
- To evaluate two different monitoring tools side by side
Correct answer: To isolate the causal effect of a single change by exposing different populations to each variant simultaneously
A/B testing isolates causality by holding all variables constant except the one being tested, enabling confident attribution of observed differences to that change.
Question 3: A cloud engineer references a 2019 study on Kubernetes networking performance to justify a current architectural decision. What concern should be raised?
- Academic studies from before 2020 are automatically invalid
- Kubernetes networking has evolved significantly since 2019 and the findings may no longer reflect current behavior (Correct answer)
- The study should be rejected because it predates widespread cloud adoption
- Only studies from the past six months are relevant to cloud decisions
Correct answer: Kubernetes networking has evolved significantly since 2019 and the findings may no longer reflect current behavior
Cloud and container technologies evolve rapidly, so older studies may reflect deprecated behavior, outdated defaults, or features that have since changed substantially.
Question 4: Which statistical concept is most important to understand when evaluating cloud cost-saving reports that claim a specific percentage reduction?
- Standard deviation of daily cloud costs
- Whether the reported change is statistically significant and not within normal variability (Correct answer)
- The absolute dollar value of the saving
- The number of engineers who reviewed the cost report
Correct answer: Whether the reported change is statistically significant and not within normal variability
Without statistical significance testing, a reported percentage reduction could simply reflect normal cost variance rather than a genuine improvement.
Question 5: A team uses the DORA metrics (deployment frequency, lead time, MTTR, change failure rate) to benchmark their engineering performance. What is a key limitation of comparing your DORA scores to published industry averages?
- DORA metrics are not applicable to cloud-native environments
- Industry averages aggregate diverse contexts and may not reflect organizations with similar tech stacks, team sizes, or domains (Correct answer)
- DORA metrics can only be measured quarterly, not continuously
- Published DORA benchmarks are typically five years behind current industry practice
Correct answer: Industry averages aggregate diverse contexts and may not reflect organizations with similar tech stacks, team sizes, or domains
Aggregated industry benchmarks mask significant contextual variation, making direct comparison without accounting for organizational similarity potentially misleading.
Question 6: What is the main advantage of using Infrastructure as Code (IaC) for research experiments in cloud environments?
- IaC reduces cloud provider billing by 30% on average
- IaC enables reproducible, version-controlled environments that can be reliably replicated for consistent experiment conditions (Correct answer)
- IaC eliminates the need for security reviews on experimental resources
- IaC allows experiments to run without cloud provider API limits
Correct answer: IaC enables reproducible, version-controlled environments that can be reliably replicated for consistent experiment conditions
IaC captures environment configuration in code, ensuring each experiment iteration starts from an identical, documented baseline — a prerequisite for reproducible results.
Question 7: A cloud team discovers conflicting recommendations between their cloud provider's Well-Architected Framework and an independent third-party guide. How should they resolve this conflict?
- Always defer to the cloud provider as the authoritative source
- Evaluate both sources for their reasoning, test the conflicting approaches in your context, and document which performs better for your workload (Correct answer)
- Discard the third-party guide as inherently biased
- Escalate to the provider's support team for a definitive ruling
Correct answer: Evaluate both sources for their reasoning, test the conflicting approaches in your context, and document which performs better for your workload
Empirically testing conflicting recommendations in your own environment produces context-specific evidence that supersedes general guidance from either source.
Cloud Engineer Research & Evidence-Based Practice 4
A cloud team wants to evaluate the security posture of their infrastructure.
Which evidence source provides the most objective, standardized baseline?