Hybrid Storage Pools in CACM

As I mentioned in my previous post, I wrote an article about the hybrid storage pool (HSP); that article appears in the recently released July issue of Communications of the ACM. You can find it here. In the article, I talk about a novel way of augmenting the traditional storage stack with flash memory as a new level in the hierarchy between DRAM and disk, as well as the ways in which we’ve adapted ZFS and optimized it for use with flash.

So what’s the impact of the HSP? Very simply, the article demonstrates that, considering the axes of cost, throughput, capacity, IOPS and power-efficiency, HSPs can match and exceed what’s possible with either drives or flash alone. Further, an HSP can be built or modified to address specific goals independently. For example, it’s common to use 15K RPM drives to get high IOPS; unfortunately, they’re expensive, power-hungry, and offer only a modest improvement. It’s possible to build an HSP that can match the necessary IOPS count at a much lower cost both in terms of the initial investment and the power and cooling costs. As another example, people are starting to consider all-flash solutions to get very high IOPS with low power consumption. Using flash as primary storage means that some capacity will be lost to redundancy. An HSP can provide the same IOPS, but use conventional disks to provide redundancy yielding a significantly lower cost.

My hope — perhaps risibly naive — is that HSPs will mean the eventual death of the 15K RPM drive. If it also puts to bed the notion of flash as general purpose mass storage, well, I’d be happy to see that as well.

Posted on July 1, 2008 at 3:49 pm by ahl · Permalink
In: Fishworks · Tagged with: , , ,

2 Responses

Subscribe to comments via RSS

  1. Written by Andrei
    on July 2, 2008 at 12:03 am

    Nice article, Adam. I agree that flash is going to change the landscape pretty soon, but I wouldn’t dismiss 15K RPM drives quiet yet though, especially since there are rumors floating around that WD is working on a 20K RPM version to combat SDD drives :)

  2. Written by Adam Leventhal
    on July 10, 2008 at 1:43 am

    @Andrei Interesting link, but note that the WD Raptor line does not seem to be intended for use in enterprise environments as evidenced by the fact that it uses a non-standard position for it’s 3.5" connector. In other words: good luck plugging a Raptor into a standard JBOD.
    I can see the utility of a hyper fast desktop drive if it turns out to be cheaper than an SSD, but filling a JBOD with 20K RPM drives will never make sense.

Subscribe to comments via RSS