Cloud Analytics: first video

The video for the Cloud Analytics talk that Bryan Cantrill and I recently gave was streamed live on ustream and available online immediately after. It’s now available edited and in hires.

Bryan Cantrill and Brendan Gregg

Bryan Cantrill and Brendan Gregg at Joyent

Just before the talk, I took screenshots of each of the demos I wanted to give, to refer to if needed. I didn’t end up using them in the talk as we were able to demo everything live. I’ve included them here to supplement the video. They show the same heatmaps we demoed, but at a different time of day with some different features visible. Watch the video for the descriptions of these heatmaps, what they are showing, and why they are useful.

These screenshots show our prototype Joyent Cloud Analytics visualizing performance on production systems. The interface (buttons and controls) that surround these heatmaps will be much improved over time. Right now, we experimenting with data collection (thanks mainly to DTrace) and how that data can be visualized (mostly heatmaps, but we are doing other graph types too).

The axes for these heat maps are:

System Call Latency by Syscall Type

System Call Latency by Application

System Call Latency by Smartmachine

System Call Latency for httpd by Syscall Type

System Call Latency for mysqld by Syscall Type

System Call Latency for mysqld, by I/O Syscall and Filesystem Type

VFS Latency by ZFS Call

VFS Latency by ZFS Call (nsecs)

CPU Dispatcher Queue Latency, by Application

MySQL Query Latency by Type

MySQL Query Latency by CPU and Filesort State

System Call Sub-Second Execution Time by Application

System Call Sub-Second Execution Time by Application

Read/Write Syscall by File Descriptor Offset

Print Friendly
Posted on January 24, 2011 at 11:55 pm by Brendan Gregg · Permalink
In: Joyent · Tagged with: , , , ,

3 Responses

Subscribe to comments via RSS

  1. [...] This post was mentioned on Twitter by Deirdré Straughan and Bryan Cantrill, Brendan Gregg. Brendan Gregg said: Extra heatmaps to supplement the first cloud analytics video: http://bit.ly/hDX4k6 [...]

  2. Written by Brendan's blog » File System Latency: part 5
    on June 16, 2011 at 4:38 pm
    Permalink

    [...] command line. This is something that we are addressing with Cloud Analytics (videos), using heat maps to display file system latency. This is done for all applications and file sytems, by tracing in [...]

  3. [...] in production to solve real issues; it wasn’t that long ago that Bryan and I were demoing the prototype. Posted on September 26, 2011 at 9:12 am by Brendan Gregg · Permalink [...]

Subscribe to comments via RSS