Detecting Outliers
In computer performance, we’re especially concerned about latency outliers: very slow database queries, application requests, disk I/O, etc. The term “outlier” is subjective: there is no rigid mathematical definition. From [Grubbs 69]: An outlying observation, or “outlier,” is one that appears to deviate markedly from other members of the sample in which it occurs. Outliers [...]
In: Performance · Tagged with: frequencytrail, latency, outliers, performance, statistics, visualizations
Revealing Hidden Latency Patterns
Latency Heat Map Response time – or latency – is crucial to understand in detail, but many of the common presentations of this data hide important details and patterns. Latency heat maps are an effective way to reveal these. I often use tools that provide heat maps directly, but sometimes I have separate trace output [...]
In: Performance · Tagged with: heatmaps, latency, performance, visualizations
Off-CPU Performance Analysis
I’ve been exercising a new approach for examining application performance, which involves measuring high resolution off-CPU time that is synchronous to the workload. This reveals which code-paths are blocked and waiting while off-CPU, and for how long exactly. This differs from traditional profiling which often samples the activity of threads at a given interval, and [...]
In: Performance · Tagged with: dtrace, latency, mysql, off-cpu, performance