Solaris and ‘Growing’ / ‘Expanding’ your Zpool – With little down time …

<zfs nerd post>

At home (on this server) I have a Zpool consisting of 3 disks in a RAIDZ1 group. I needed more disc space, so 1 by 1 I changed my 3 x 500G drives to 1tb drives. This would of been pretty much no down time (except for an export and import of the pool) if my hardware had hot swapable drive – The cheap Dell SC430 doesen’t do that unfortunately.

It took around 8 hours each for the first two discs – But the last one took over 20 hours! No idea why – My system was idle with just the resilvering taking place. If you have had experiences with this leave me a comment with how long this process took you.

SO my pool ‘dump’ went from

dump                   921G    37K   112G     1%    /dump

to

dump                   1.8T    37K   1.1T     1%    /dump

If you want to ever do this process, ZFS (once all the discs are the same size) just sees that and grows. All you need to do is replace your discs 1 by and and let them rebuild. No mucking around moving data. The best part is your Data is still avaliable, during the whole process, all be it slow to access but if you need a something you can get it. 🙂

</zfs nerd post>

Maxing out Gig Ethernet with Sun x4500 Thumpers

Well the time has come where I have finally got some hardware that can max out gig ethernet. I sent 3.4 tb in 9 hours! Thats awesome! GG Cisco 3750 and 2 x Sun x4500 Thumpers running Opensolaris snv_105. Good times – I bet the copper was warm 🙂

root@dumper1:sbin> ./zfsMbufferInitialSend.sh
Starting ZFS send to dumper-tmp.ansto.gov.au @ Fri Mar  6 16:02:47 EST 2009
in @  0.0 kB/s, out @ 34.9 MB/s, 3428 GB total, buffer   0% fullll

summary: 3428 GByte in 8 h 57 min  109 MB/s

real    537m40.533s
user    34m32.281s
sys     326m18.227s
Completed @ Sat Mar  7 01:00:34 EST 2009

If you do use x4500s or have the need to zfs send compile mbuffer today! It rocks – I went from 30mbyte a second with SSH to maxing out Gigabit Ethernet. I will post instructions on everything I did soon.