Archive for the ‘cloud analytics’ Category
Subsecond Offset Heat Maps
“Wow, that’s weird!”. My subsecond offset visualization type looked great, but others found it weird and unfamiliar. I developed it for inclusion in Joyent’s Cloud Analytics tool for the purposes of workload characterization. Given that it was so unfamiliar, I had some explaining to do. Voxer, a company that makes a walkie-talkie application for smart [...]
In: cloud analytics, DTrace, performance, subsecond, visualizations
Observing Observer: A Cloud Analytics Case Study
On the weekend of August 27-29, Joyent hosted Node Knockout 2011, a 48-hour coding competition for node.js developers from around the world, working individually or in teams. The contest entries were all hosted on Joyent’s no.de platform, running on SmartDataCenter and SmartOS. The winning entry was Observer by Arnout Kazemeir, a service which “allows you [...]
In: cloud analytics, DTrace, example, joyent, performance, visualizations
New metrics on no.de
You may have noticed that the no.de service got a big facelift last week. The new version of the software has a lot of new features, among them some pretty substantial improvements to Analytics. Recall that we already had metrics for Node.js HTTP server and client operations, garbage collection, socket ops, filesystem ops, and CPU executions. We’ve now [...]
In: cloud analytics, joyent, Node.js
Distributed Web Architures @ SF Node.js Meetup
At the Node Meetup here at Joyent‘s offices a few weeks ago I gave a brief talk about Cloud Analytics as a distributed web architecture. Matt Ranney of Voxer and Curtis Chambers of Uber also spoke about their companies’ web architectures….
In: cloud analytics, DTrace, joyent, Node.js, smartos
OSCON Slides
I’ve posted the slides from Brendan‘s and my talk yesterday at OSCON Data called “Design and Implementation of a Real-Time Cloud Analytics Platform.” Thanks to everyone who attended. We’d love to get your feedback! And thanks to @adrianco for this photo of our demo.
In: cloud analytics, DTrace, joyent, Node.js, smartos
File System Latency: part 5
This is part 5 of File System Latency, a series on storage I/O performance from the application perspective (see parts 1, 2, 3 and 4). Previously I explained why disk I/O metrics may not reflect application performance, and how some file system issues may be invisible at the disk I/O level. I then showed how [...]
In: cloud analytics, DTrace, filesystem, latency, mysql, performance, vfsstat
DTrace probes for Node v0.4.x
As a part of the work for Cloud Analytics that Dave, Bryan, Brendan, and I been doing, we’ve added several USDT probes to Node. As I’ve been doing a lot of the integration work and working with Ryan Dahl to get them into Node itself, I thought that I would document what we’ve added and [...]
Cloud Analytics: first video
The video for the Cloud Analytics talk that Bryan Cantrill and I recently gave was streamed live on ustream and available online immediately after. It’s now available edited and in hires. Bryan Cantrill and Brendan Gregg at Joyent Just before the talk, I took screenshots of each of the demos I wanted to give, to [...]
In: cloud analytics, joyent, performance, video
Solving Problems with Cloud Analytics
This past Wednesday Brendan Gregg and Bryan Cantrill gave a presentation on the work that’s been going on at Joyent related to visualizing performance and how we’re using this to solve customer problems. This is based on the work that the the four of us (Bryan, Brendan, Dave and I) have been doing. You can [...]
In: cloud analytics, DTrace, joyent
Cloud Analytics: first look
Since I joined Joyent late last year, I’ve been working with Bryan Cantrill, Dave Pacheco and Robert Mustacchi on the next generation of performance visualizations, called “Cloud Analytics”. I gave some previews (with software then
In: cloud analytics, joyent
