Been pretty busy, so I popped off a download on mrx to test Starting a performance analysis of my Frankenstien vs Sun w2100z. It is currently running Fedora Core 6 (for another project) and saw it get:

[tdh@mrx ~/]> wget http://mirror.mcs.anl.gov/pub/ubuntu-iso/DVDs/ubuntu/edgy/release/ubuntu-6.10-dvd-i386.iso

 0% [] 2,753,773    791K/s  eta 1h 47m 

I think it is safe to say that the cache at Sun is not helping my w2100z to beat my Frankenstien. Also, it could be that the VPN is imposing a penalty on the w2100z.

My guess is going to go either with the NIC/driver or the harddisk or ZFS. There, I've narrowed it down.

First, lets look at ZFS:

[tdh@kanigix ~]> zfs get all zoo
NAME  PROPERTY       VALUE                  SOURCE
zoo   type           filesystem             -
zoo   creation       Sun Jan 14 14:08 2007  -
zoo   used           15.2G                  -
zoo   available      668G                   -
zoo   referenced     39.6K                  -
zoo   compressratio  1.04x                  -
zoo   mounted        yes                    -
zoo   quota          none                   default
zoo   reservation    none                   default
zoo   recordsize     128K                   default
zoo   mountpoint     /zoo                   default
zoo   sharenfs       off                    default
zoo   shareiscsi     off                    default
zoo   checksum       on                     default
zoo   compression    off                    default
zoo   atime          on                     default
zoo   devices        on                     default
zoo   exec           on                     default
zoo   setuid         on                     default
zoo   readonly       off                    default
zoo   zoned          off                    default
zoo   snapdir        hidden                 default
zoo   aclmode        groupmask              default
zoo   aclinherit     secure                 default
zoo   canmount       on                     default
zoo   xattr          on                     default

So, no compression enabled. Bzzt, we have to dig deeper:

[tdh@kanigix ~]> zfs get all zoo/home
NAME      PROPERTY       VALUE                  SOURCE
zoo/home  type           filesystem             -
zoo/home  creation       Sun Jan 14 14:10 2007  -
zoo/home  used           8.48G                  -
zoo/home  available      668G                   -
zoo/home  referenced     44.1K                  -
zoo/home  compressratio  1.08x                  -
zoo/home  mounted        yes                    -
zoo/home  quota          none                   default
zoo/home  reservation    none                   default
zoo/home  recordsize     128K                   default
zoo/home  mountpoint     /export/zfs            local
zoo/home  sharenfs       on                     local
zoo/home  shareiscsi     off                    default
zoo/home  checksum       on                     default
zoo/home  compression    on                     local
zoo/home  atime          on                     default
zoo/home  devices        on                     default
zoo/home  exec           on                     default
zoo/home  setuid         on                     default
zoo/home  readonly       off                    default
zoo/home  zoned          off                    default
zoo/home  snapdir        hidden                 default
zoo/home  aclmode        groupmask              default
zoo/home  aclinherit     secure                 default
zoo/home  canmount       on                     default
zoo/home  xattr          on                     default

Okay, before we fiddle with ZFS, lets check to see if we can eliminate it as a suspect:

[tdh@kanigix /kanigix]> df -h .
Filesystem             size   used  avail capacity  Mounted on
/dev/dsk/c1d1s4         21G    21M    20G     1%    /kanigix
[tdh@kanigix /kanigix]> wget http://mirror.mcs.anl.gov/pub/ubuntu-iso/DVDs/ubuntu/edgy/release/ubuntu-6.10-dvd-i386.iso

 0% [ ] 4,213,237    291.40K/s  ETA 3:22:18^C

So it does look like a factor! Not really - while I am getting better speeds than the other day, they are on par with the zfs filesystem today:

[tdh@kanigix ~]> df -h .
Filesystem             size   used  avail capacity  Mounted on
zoo/home/tdh           683G   8.5G   668G     2%    /export/zfs/tdh
[tdh@kanigix ~]> wget http://mirror.mcs.anl.gov/pub/ubuntu-iso/DVDs/ubuntu/edgy/release/ubuntu-6.10-dvd-i386.iso

 0% [  ] 2,832,077    323.02K/s  ETA 3:22:50^C

I think I've eliminated both the disk and ZFS from being the problem. I think the issue is probably the network card or the driver. I'll have to see if there is a fix for my nge0 problem and then I can try it instead of the rge0.

[tdh@kanigix ~]> ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
        inet 127.0.0.1 netmask ff000000 
rge0: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 2
        inet 192.168.2.115 netmask ffffff00 broadcast 192.168.2.255