Archive for the ‘cloud analytics’ Category

Subsecond Offset Heat Maps

“Wow, that’s weird!”. My subsecond offset visualization type looked great, but others found it weird and unfamiliar. I developed it for inclusion in Joyent’s Cloud Analytics tool for the purposes of workload characterization. Given that it was so unfamiliar, I had some explaining to do. Voxer, a company that makes a walkie-talkie application for smart [...]

Posted on March 26, 2012 at 11:16 am by Brendan Gregg · Permalink · Comments Closed
In: cloud analytics, DTrace, performance, subsecond, visualizations

Observing Observer: A Cloud Analytics Case Study

On the weekend of August 27-29, Joyent hosted Node Knockout 2011, a 48-hour coding competition for node.js developers from around the world, working individually or in teams. The contest entries were all hosted on Joyent’s no.de platform, running on SmartDataCenter and SmartOS. The winning entry was Observer by Arnout Kazemeir, a service which “allows you [...]

Posted on September 26, 2011 at 9:12 am by Brendan Gregg · Permalink · Comments Closed
In: cloud analytics, DTrace, example, joyent, performance, visualizations

New metrics on no.de

You may have noticed that the no.de service got a big facelift last week. The new version of the software has a lot of new features, among them some pretty substantial improvements to Analytics. Recall that we already had metrics for Node.js HTTP server and client operations, garbage collection, socket ops, filesystem ops, and CPU executions. We’ve now [...]

Posted on August 29, 2011 at 5:55 pm by dap · Permalink · Comments Closed
In: cloud analytics, joyent, Node.js

Distributed Web Architures @ SF Node.js Meetup

At the Node Meetup here at Joyent‘s offices a few weeks ago I gave a brief talk about Cloud Analytics as a distributed web architecture. Matt Ranney of Voxer and Curtis Chambers of Uber also spoke about their companies’ web architectures….

Posted on August 23, 2011 at 2:05 pm by dap · Permalink · Comments Closed
In: cloud analytics, DTrace, joyent, Node.js, smartos

OSCON Slides

I’ve posted the slides from Brendan‘s and my talk yesterday at OSCON Data called “Design and Implementation of a Real-Time Cloud Analytics Platform.” Thanks to everyone who attended. We’d love to get your feedback!  And thanks to @adrianco for this photo of our demo.

Posted on July 27, 2011 at 10:07 am by dap · Permalink · Comments Closed
In: cloud analytics, DTrace, joyent, Node.js, smartos

File System Latency: part 5

This is part 5 of File System Latency, a series on storage I/O performance from the application perspective (see parts 1, 2, 3 and 4). Previously I explained why disk I/O metrics may not reflect application performance, and how some file system issues may be invisible at the disk I/O level. I then showed how [...]

Posted on June 3, 2011 at 12:02 pm by Brendan Gregg · Permalink · Comments Closed
In: cloud analytics, DTrace, filesystem, latency, mysql, performance, vfsstat

DTrace probes for Node v0.4.x

As a part of the work for Cloud Analytics that Dave, Bryan, Brendan, and I been doing, we’ve added several USDT probes to Node. As I’ve been doing a lot of the integration work and working with Ryan Dahl to get them into Node itself, I thought that I would document what we’ve added and [...]

Posted on March 1, 2011 at 3:50 pm by rm · Permalink · Comments Closed
In: cloud analytics, DTrace

Cloud Analytics: first video

The video for the Cloud Analytics talk that Bryan Cantrill and I recently gave was streamed live on ustream and available online immediately after. It’s now available edited and in hires. Bryan Cantrill and Brendan Gregg at Joyent Just before the talk, I took screenshots of each of the demos I wanted to give, to [...]

Posted on January 24, 2011 at 4:55 pm by Brendan Gregg · Permalink · Comments Closed
In: cloud analytics, joyent, performance, video

Solving Problems with Cloud Analytics

This past Wednesday Brendan Gregg and Bryan Cantrill gave a presentation on the work that’s been going on at Joyent related to visualizing performance and how we’re using this to solve customer problems. This is based on the work that the the four of us (Bryan, Brendan, Dave and I) have been doing. You can [...]

Posted on January 22, 2011 at 11:31 am by rm · Permalink · Comments Closed
In: cloud analytics, DTrace, joyent

Cloud Analytics: first look

Since I joined Joyent late last year, I’ve been working with Bryan Cantrill, Dave Pacheco and Robert Mustacchi on the next generation of performance visualizations, called “Cloud Analytics”. I gave some previews (with software then

Posted on January 17, 2011 at 5:13 pm by Brendan Gregg · Permalink · Comments Closed
In: cloud analytics, joyent