2 Replies Latest reply: Oct 15, 2013 11:36 AM by infra RSS

    vdbench - Solaris - can't configure desired write I/O rate

    infra

      Hi,

       

      I'm trying to run a peak load for an hour on a particular lun. Running Solaris 10(x86) connected to EMC VNX with 8Gb/s HBAs on the server and 8GB/s FC port on the VNX.

       

      My Parameter file:

      sd=sd1,lun=/dev/rdsk/c4t60060160C4303400907DC93F8515E311d0s2

      wd=write,sd=sd1,readpct=0,xfersize=(0.5k,0.02,1.5k,0.5,3k,0.4,6k,17.88,15k,11.22,28k,7.4,60k,6.65,120k,55.38,230k,0.05,512k,0.5)

      rd=writerun,wd=(write),maxdata=193.87g,elapsed=3600,threads=50,iorate=3137

       

      No matter what combination of threads or iorate I try I can't get the throughput I need. I have tried increasing threads and iorate both independently of each other and together.

      I have tried using multiple jvms using hd=localhost,jvms=20 but I see the same problems.

      Vdbench starts, goes as fast as it can and then after 30s or so it reduces to 20-25MB/s

       

      ./vdbench -f threadpeak -o threadinc

       

       

      Vdbench distribution: vdbench504

      For documentation, see 'vdbench.pdf'.

       

      19:03:44.822 input argument scanned: '-fthreadpeak'

      19:03:44.823 input argument scanned: '-othreadinc'

      19:03:44.964 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-10-131014-19.03.44.723 -l localhost-0 -p 5570

      19:03:44.966 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-13-131014-19.03.44.723 -l localhost-3 -p 5570

      19:03:44.975 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-11-131014-19.03.44.723 -l localhost-1 -p 5570

      19:03:44.976 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-12-131014-19.03.44.723 -l localhost-2 -p 5570

      19:03:44.986 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-16-131014-19.03.44.723 -l localhost-6 -p 5570

      19:03:44.995 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-15-131014-19.03.44.723 -l localhost-5 -p 5570

      19:03:44.996 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-14-131014-19.03.44.723 -l localhost-4 -p 5570

      19:03:45.035 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-17-131014-19.03.44.723 -l localhost-7 -p 5570

      19:03:45.051 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-18-131014-19.03.44.723 -l localhost-8 -p 5570

      19:03:45.089 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-19-131014-19.03.44.723 -l localhost-9 -p 5570

      19:03:45.111 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-20-131014-19.03.44.723 -l localhost-10 -p 5570

      19:03:45.112 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-21-131014-19.03.44.723 -l localhost-11 -p 5570

      19:03:45.112 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-22-131014-19.03.44.723 -l localhost-12 -p 5570

      19:03:45.162 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-24-131014-19.03.44.723 -l localhost-14 -p 5570

      19:03:45.164 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-23-131014-19.03.44.723 -l localhost-13 -p 5570

      19:03:45.164 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-25-131014-19.03.44.723 -l localhost-15 -p 5570

      19:03:45.212 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-26-131014-19.03.44.723 -l localhost-16 -p 5570

      19:03:45.213 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-27-131014-19.03.44.723 -l localhost-17 -p 5570

      19:03:45.213 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-28-131014-19.03.44.723 -l localhost-18 -p 5570

      19:03:45.266 Starting slave: /var/tmp/vdbench/vdbench SlaveJvm -m localhost -n localhost-29-131014-19.03.44.723 -l localhost-19 -p 5570

      19:03:45.734 All slaves are now connected

      19:03:49.001 Starting RD=writerun; I/O rate: Uncontrolled MAX; elapsed=3600; For loops: threads=256

       

      Oct 14, 2013  interval        i/o   MB/sec   bytes   read     resp     read    write     resp     resp queue  cpu%  cpu%

                                 rate    1024**2    i/o     pct     time     resp     resp      max   stddev depth sys+u   sys

      19:03:50.178         1    8389.00   606.76   75841   0.00   17.859    0.000   17.859  510.658   38.623 243.5  15.2   9.3

      19:03:51.077         2     338.00    24.98   77481   0.00  687.685    0.000  687.685 1085.501  232.083 248.8   6.9   2.6

      19:03:52.035         3     357.00    26.40   77535   0.00  757.307    0.000  757.307 1081.140  267.449 256.0   4.3   2.8

      19:03:53.034         4     345.00    24.82   75446   0.00  702.453    0.000  702.453 1025.476  242.047 256.0   3.6   2.3

      19:03:54.030         5     341.00    24.00   73788   0.00  732.512    0.000  732.512 1047.871  256.691 256.0   3.5   2.5

      19:03:55.029         6     351.00    25.77   76991   0.00  741.148    0.000  741.148 1041.604  261.615 256.0   3.4   2.5

      19:03:56.026         7     279.00    24.11   90620   0.00  839.610    0.000  839.610 1215.745  272.126 256.0   3.4   2.4

      19:03:57.027         8     314.00    25.01   83509   0.00  882.493    0.000  882.493 1248.504  311.509 255.8   3.4   2.3

      19:03:58.023         9     301.00    24.69   85998   0.00  814.099    0.000  814.099 1148.997  289.843 256.0   3.8   2.3

      19:03:59.025        10     260.00    23.10   93148   0.00  923.690    0.000  923.690 1295.877  301.891 256.0   3.1   2.3

      19:04:00.022        11     307.00    23.67   80829   0.00  886.548    0.000  886.548 1314.109  323.586 256.0   3.7   2.3

      19:04:01.021        12     292.00    24.23   87022   0.00  871.124    0.000  871.124 1231.372  294.764 256.0   3.0   2.3

      19:04:02.039        13     294.00    24.01   85648   0.00  879.635    0.000  879.635 1227.616  301.822 256.0   2.9   2.1

      19:04:03.021        14     317.00    25.69   84962   0.00  841.806    0.000  841.806 1187.697  293.892 256.0   3.1   2.1

      19:04:04.024        15     305.00    25.60   88023   0.00  811.186    0.000  811.186 1251.991  275.355 256.0   3.2   2.3

      19:04:05.021        16     291.00    23.67   85296   0.00  860.202    0.000  860.202 1223.327  279.924 256.0   3.3   2.4

      19:04:06.022        17     303.00    24.84   85953   0.00  860.518    0.000  860.518 1253.826  302.680 256.0   3.2   2.4

      19:04:07.024        18     274.00    22.79   87217   0.00  912.409    0.000  912.409 1298.445  297.082 256.0   3.3   2.3

      19:04:08.021        19     310.00    24.42   82588   0.00  830.927    0.000  830.927 1229.616  297.374 256.0   3.9   2.6

      ^CCTRL-C requested. vdbench terminating

       

      I'm probably missing something obvious.....

       

      Any help appreciated :-)