Performance Analysis & Benchmarking Flashcards
7 cards from real CTP practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Performance Analysis & Benchmarking flashcards as text
A soak (endurance) test runs at moderate load for 48 hours. Which problem is it best suited to uncover?
Answer: Memory leaks and gradual resource exhaustion
Long-duration tests reveal slow-growing problems such as memory leaks and handle exhaustion.
When comparing two systems across several benchmark ratios normalized to a reference machine, which mean does SPEC use to summarize the results?
Answer: Geometric mean
SPEC uses the geometric mean of normalized ratios because it stays consistent no matter which reference machine is chosen.
A load test client machine hits 100% CPU while the target server sits at 30%. What does this suggest about the results?
Answer: The load generator is the bottleneck, so the results understate server capacity
A saturated load generator can't produce enough traffic, so the measured limit belongs to the client, not the server.
What does the term 'coordinated omission' describe in latency benchmarking?
Answer: A load tool that stalls during slow responses and so fails to record the delays queued requests would have faced
Coordinated omission happens when the tester waits on slow responses and skips the requests it should have sent, which makes tail latency look better than it is.
Which statistic best indicates how repeatable a set of benchmark runs is?
Answer: Coefficient of variation (standard deviation / mean)
A low coefficient of variation means results are consistent from run to run.
As utilization of a single-server queue approaches 100%, what generally happens to response time?
Answer: It rises sharply, nonlinearly
In queueing theory, wait time grows roughly in proportion to 1/(1−ρ), so it climbs steeply as utilization nears 100%.
Which tool type samples a running program's call stack at intervals to show where CPU time is spent?
Answer: Sampling profiler
Sampling profilers capture stack traces periodically to estimate how time is distributed across functions.
Written and edited by Nathan Beja, founder of Practice Test Geeks, with AI assistance. We have not yet matched this exam's facts to an official source, so confirm fees, dates and rules with the exam body. Editorial policy