My first experience with XIV and VAAI

As I blogged previously, VAAI support for XIV has two dependencies:

  1. 10.2.4a code
  2. Vmware Certified driver

Both of these things are very close to release….
In the meantime I have had the chance to demonstrate the uncertified VAAI driver with XIV 10.2.4 code, just to see what affect it has.

And what is the affect?

Its mindblowing!

VAAI dramatically reduces the amount of work that the vSphere 4.1 server needs to do to get things done.

The XIV implementation of VAAI provides the three fundamentals of VAAI:

  1. Full clone, copying data from one logical unit (LUN based) to another without writing to the ESX server.
  2. Block Zeroing, assigning zeros to large storage areas without actually sending the zeros to the storage system.
  3. Hardware Assisted locking, locking a particular range of blocks in a shared logical unit (providing exclusive access to these blocks), instead of using SCSI reservation that locks the entire logical unit.

To test VAAI with XIV, I did two things:   a VMDK migration (a Storage Vmotion) and VMDK cloning.    I used the vSphere client to time how long the operation took and XIV Top to see how much IO was being generated by the vSphere server.    Now please understand, these numbers and timings are based on a lab environment.   The speed and peaks will vary from client to client and install to install.

Firstly the migration:  I performed a migration of a VMDK from one data store to another. The migration without VAAI took 42 seconds as can be seen from the screen capture below:

The migration generated a peak of 135 MBps of traffic being written to the target volume as can be seen from XIV Top:

I then turned on VAAI and did the same migration.  I won’t document the process to install the VAAI driver, as it will be different when the certified version is released.  However after the driver is installed, I could turn VAAI on and off by toggling these settings from 0 1 and back again:

I we did another VMDK migration with VAAI enabled.   This time the migration took 19 seconds (as opposed to 42 seconds), so an immediate improvement occurred.

When I checked XIV Top, there was no IO at all!  In other words the vMotion was done with no apparent load on the vSphere  HBAs or the SAN.  I feel silly showing this screen capture, but this is what I saw…. nothing.

I then did a VMDK clone.  The Data store was on XIV, VAAI was not enabled.   There was no other IO running on the ESX server.  The clone took 40 seconds (as reported by vCenter):

The clone generated a peak of 230 MBps for around 50 seconds (as reported by XIV Top)

We then again activated VAAI and repeated the clone.  Now the clone took 15 seconds (as reported by vCenter), so thats 25 seconds faster (more than 50%).

The clone generated a peak of 2 MBps for around 20 seconds (as reported by XIV Top).  Almost no fibre channel IO was thus generated by the clone.

As I have blogged before,  I will be repeating this whole exercise once I have real live customers running this configuration, so expect further updates.

Advertisements

About Anthony Vandewerdt

I am an IT Professional who lives and works in Melbourne Australia. This blog is totally my own work. It does not represent the views of any corporation. Constructive and useful comments are very very welcome.
This entry was posted in Uncategorized. Bookmark the permalink.

4 Responses to My first experience with XIV and VAAI

  1. Ronny Steiner says:

    Wow that’s really amazing! I can’t wait to try it by myself.
    BTW: Do you know a release date for 10.2.4a and the VMware certified driver?

  2. avandewerdt says:

    The 10.2.4a code is now available. You need to contact IBM to get it installed.
    The Vmware driver, I am still investigating….

  3. Michael says:

    very nice!

    we will get our XIV delivered tomorrow!
    we also got IBM x3690 servers this week.
    We will build up a complete new vmware cluster and we will also do some benchmarking with VAAI before going live..
    Hope the final Vmware Driver will be released soon!?

    Cheers

  4. avandewerdt says:

    Its very close, the VMware website is now showing the XIV as VAAI approved and listing the name of the VAAI API.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s