Archive for the ‘performance’ Category

Another 10 Performance Wins

Following on from my earlier 10 performance wins post, here is another group of 10 I have worked on. # Target Analyzed Key Tool Fixed Specific Improvement 11 redis System DTrace System scheduler 41% 12 rsync System DTrace Application app config 5x 13 mongoperf System DTrace System ZFS tuning up to 8x 14 backups System [...]

Posted on February 11, 2014 at 11:08 am by Brendan Gregg · Permalink · Comments Closed
In: performance, wins

The OpenZFS write throttle

In my last blog post, I wrote about the ZFS write throttle, and how we saw it lead to pathological latency variability on customer systems. Matt Ahrens, the co-founder of ZFS, and I set about to fix it in OpenZFS. While the solution we came to may seem obvious, we arrived at it only through [...]

Posted on February 9, 2014 at 8:55 pm by ahl · Permalink · Comments Closed
In: MattAhrens, OpenZFS, performance, ZFS

Benchmarking the Cloud

Benchmarking, and benchmarking the cloud, is incredibly error prone. I provided guidance though this minefield in the benchmarking chapter of my book (Systems Performance: Enterprise and the Cloud); that chapter can be read online on the InformIT site. I also gave a lightning talk about benchmarking gone wrong at Surge last year. In this post, [...]

Posted on January 10, 2014 at 4:05 pm by Brendan Gregg · Permalink · Comments Closed
In: benchmarking, Cloud, performance

ZFS fundamentals: the write throttle

It’s no small feat to build a stable, modern filesystem. The more I work with ZFS, the more impressed I am with how much it got right, and how malleable it’s proved. It has evolved to fix shortcomings and accommodate underlying technological shifts. It’s not surprising though that even while its underpinnings have withstood the [...]

Posted on December 26, 2013 at 5:40 pm by ahl · Permalink · Comments Closed
In: latency, MattAhrens, OpenZFS, performance, Throughput, ZFS

Systems Performance: available now

My new book Systems Performance: Enterprise and the Cloud is shipping now from your favorite online book supplier (informIT, amazon). Thanks to those who have ordered a copy! I’ve already received feedback from people finding it useful, which is really gratifying. For an intro to the book, see my previous blog post about it. I’ve [...]

Posted on October 28, 2013 at 3:57 pm by Brendan Gregg · Permalink · Comments Closed
In: book, performance

Open Source Systems Performance

There is an important and untold story about open source and systems performance, which I’m uniquely positioned to tell. I presented it at OSCON earlier this year, which was the perfect venue. My talk, Open Source Systems Performance, was a play in three acts: Act 1. Before Open Source Act 2. Open Source Act 3. [...]

Posted on October 20, 2013 at 12:17 pm by Brendan Gregg · Permalink · Comments Closed
In: Open Source, performance, slides, Solaris, talk, video

The TSA Method

TSA Method in class (SmartOS) There are two basic performance analysis methodologies you can use for most performance issues. The first is the resource-oriented USE Method, which provides a checklist for identifying common bottlenecks and errors. The second is the thread-oriented TSA Method, for identifying issues causing poor thread performance. I summarized the TSA Method [...]

Posted on October 11, 2013 at 12:20 pm by Brendan Gregg · Permalink · Comments Closed
In: methodology, performance, smartos, tsamethod

The USE Method: Unix 7th Edition Performance Checklist

PDP 11/70 front panel (similar to the 11/45) Out of curiosity, I’ve developed a USE Method-based performance checklist for Unix 7th Edition on a PDP-11/45, which I’ve been running via a PDP simulator. 7th Edition is from 1979, and was the first Unix with iostat(1M) and pstat(1M), enabling more serious performance analysis from shipped tools. [...]

Posted on September 29, 2013 at 2:37 am by Brendan Gregg · Permalink · Comments Closed
In: performance, Unix, usemethod

The USE Method: FreeBSD Performance Checklist

In this post, I’ll provide an example USE Method-based performance checklist for FreeBSD, for identifying common bottlenecks and errors. This is intended to be used early in a performance investigation, before moving onto more time consuming methodologies. This should be helpful for anyone using FreeBSD, especially system administrators. This was developed on FreeBSD 10.0 alpha, [...]

Posted on September 25, 2013 at 11:42 am by Brendan Gregg · Permalink · Comments Closed
In: FreeBSD, performance, usemethod

The USE Method: Mac OS X Performance Checklist

This is my example USE Method-based performance checklist for the Apple Mac OS X operating system, for identifying common bottlenecks and errors. This draws upon both command line and graphical tools for coverage, focusing where possible on those that are provided with the OS by default, or by Apple (eg, Instruments). Further notes about tools [...]

Posted on September 18, 2013 at 11:37 pm by Brendan Gregg · Permalink · Comments Closed
In: DTrace, Mac OS X, macosx, performance, usemethod