4 Replies Latest reply on Sep 9, 2014 4:24 AM by MichR

    Error : INCORRECT_SIZE Vdbench determined that not enough bytes were read or written

    MichR

      Hi ,

       

      Not sure i understand the reason for this error , it all fell apart in the format area what was he trying to write?  Hope you can help

      This is the param file :

      ---------------------------------------------------------------------------------------

      debug=25

      fsd=fsd1,anchor=/mnt/ibox505/node-2/fs14097516111,depth=10,width=2,files=10,size=1M,distribution=all

      fsd=fsd2,anchor=/mnt/ibox505/node-2/fs14097516112,depth=10,width=2,files=10,size=1M,distribution=all

      fsd=fsd3,anchor=/mnt/ibox505/node-2/fs14097516113,depth=10,width=2,files=10,size=1M,distribution=all

      fsd=fsd4,anchor=/mnt/ibox505/node-2/fs14097516114,depth=10,width=2,files=10,size=1M,distribution=all

      fsd=fsd5,anchor=/mnt/ibox505/node-2/fs14097516115,depth=10,width=2,files=10,size=1M,distribution=all

       

      fwd=default,xfersize=4k,fileio=sequential,fileselect=random,threads=100

      fwd=fwd1,fsd=fsd1,operation=read

       

      rd=rd1,fwd=fwd*,fwdrate=max,format=yes,elapsed=30,interval=1

      ---------------------------------------------------------------------------------------

       

      This is the stdout file :

      ---------------------------------------------------------------------------------------

      16:40:25.206 16:40:25.206 Beginning of run setup

      16:40:25.206 16:40:25.206 **********************

      16:40:25.206

      16:40:25.206

      16:40:25.263 16:40:25.263 File '/var/log/messages.1' does not exist. Monitoring bypassed

      16:40:25.272 16:40:25.271 Deleting old file structure.

      16:40:25.630 16:40:25.629 Completed the creation of the directory list for /mnt/ibox505/node-2/fs14097516111: 2046 directories.

      16:40:25.635 16:40:25.635 Memory total Java heap: 123.500 MB; Free: 79.285 MB; Used: 44.215 MB;

      16:40:25.690 16:40:25.690 checkMemory()

      16:40:25.691 16:40:25.691 Memory total Java heap: 123.500 MB; Free: 107.514 MB; Used: 15.986 MB;

      16:40:25.728 16:40:25.728 Generated 20460 file names; total anchor size: 19.980g

      16:40:25.728 16:40:25.728 Writing control file for anchor=/mnt/ibox505/node-2/fs14097516111 at start of run.

      16:40:25.775 16:40:25.775 Completed control file for anchor=/mnt/ibox505/node-2/fs14097516111 at start of run. dirs: 2046/0 files: 20460/0 sizes: 19.980g/0.0/0/0.0

      16:40:25.781 16:40:25.781 Skew for fwd=format,fsd=fsd1,operation=read: 100.0

      16:40:25.803 16:40:25.803 Started 8 threads for fwd=format,fsd=fsd1

      16:40:25.803 16:40:25.803 Started 8 FwgThreads

      16:40:25.803 16:40:25.803 Waiting for task synchronization

      16:40:25.803 16:40:25.803 task_wait_start_complete() end

       

      16:40:26.001 Starting RD=format_for_rd1

       

      16:40:26.003 16:40:26.003 task_run_all(): 9 tasks

      16:40:26.341 16:40:26.341 Message to master: anchor=/mnt/ibox505/node-2/fs14097516111 mkdir complete.

      16:40:26.352 16:40:26.351 Invalid byte count. Expecting 131072

      16:40:26.352 16:40:26.352 Invalid byte count. Expecting 131072

      16:40:26.352 16:40:26.352 Invalid byte count. Expecting 131072

      16:40:26.352 16:40:26.352 Invalid byte count. Expecting 131072

      16:40:26.352 16:40:26.352 Invalid byte count. Expecting 131072

      16:40:26.352 16:40:26.352 Invalid byte count. Expecting 131072

      16:40:26.352 16:40:26.352 Invalid byte count. Expecting 131072

      16:40:26.352 16:40:26.352 but wrote only 20480 bytes.

      16:40:26.352 16:40:26.352 but wrote only 12288 bytes.

      16:40:26.352 16:40:26.352 but wrote only 4096 bytes.

      16:40:26.352 16:40:26.352 but wrote only 49152 bytes.

      16:40:26.352 16:40:26.352 but wrote only 12288 bytes.

      16:40:26.352 16:40:26.352 but wrote only 4096 bytes.

      16:40:26.353 16:40:26.352 but wrote only 57344 bytes.

      16:40:26.356 16:40:26.356

      16:40:26.357 16:40:26.356 Error writing file /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0003.file

      16:40:26.357 16:40:26.356 Error: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written

      16:40:26.357 16:40:26.357 lba: 0

      16:40:26.357 16:40:26.357 xfersize: 131072

      16:40:26.357 16:40:26.357 blocks_done: 0

      16:40:26.357 16:40:26.357 bytes_done: 0

      16:40:26.357 16:40:26.357 open_for_read: false

      16:40:26.357 java.lang.RuntimeException: Error writing file /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0003.file

      16:40:26.357 16:40:26.357

      16:40:26.357 Error: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written

      16:40:26.357 lba: 0

      16:40:26.357 xfersize: 131072

      16:40:26.358 blocks_done: 0

      16:40:26.358 bytes_done: 0

      16:40:26.358 open_for_read: false

      16:40:26.358 at Vdb.common.failure(common.java:308)

      16:40:26.358 at Vdb.ActiveFile.writeError(ActiveFile.java:611)

      16:40:26.358 at Vdb.ActiveFile.writeBlock(ActiveFile.java:458)

      16:40:26.358 at Vdb.FwgThread.doSequentialWrite(FwgThread.java:327)

      16:40:26.358 at Vdb.OpCreate.doOperation(OpCreate.java:51)

      16:40:26.358 at Vdb.OpFormat.doOperation(OpFormat.java:91)

      16:40:26.358 at Vdb.FwgThread.run(FwgThread.java:157)

      ---------------------------------------------------------------------------------------

       

      And this is the Logfile:

      ---------------------------------------------------------------------------------------

      16:40:26.002 Starting RD=format_for_rd1

       

      16:40:26.341 localhost-0: anchor=/mnt/ibox505/node-2/fs14097516111 mkdir complete.

      16:40:26.356 localhost-0: 16:40:26.353 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0003.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written 

      16:40:26.357 localhost-0: 16:40:26.356 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0001.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written 

      16:40:26.358 localhost-0: 16:40:26.357 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0006.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written 

      16:40:26.359 localhost-0: 16:40:26.358 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0004.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written 

      16:40:26.361 localhost-0: 16:40:26.359 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0008.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written 

      16:40:26.362 localhost-0: 16:40:26.361 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0007.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written 

      16:40:26.363 localhost-0: 16:40:26.362 op: write lun: /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0005.file lba: 0 0x00000000 xfer: 131072 errno: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written 

      16:40:26.533

      16:40:26.534 **********************************************************

      16:40:26.534 Slave localhost-0 aborting: Error writing file /mnt/ibox505/node-2/fs14097516111/vdb.1_1.dir/vdb_f0003.file

      Error: 798 INCORRECT_SIZE Vdbench determined that not enough bytes were read or written

      lba: 0

      xfersize: 131072

      blocks_done: 0

      bytes_done: 0

      open_for_read: false

      16:40:26.534 **********************************************************

      16:40:26.534

      16:40:28.003 Exception from slave: localhost-0

      16:40:28.004

      16:40:28.004 common.failure():

      java.net.SocketException: Broken pipe

      java.net.SocketException: Broken pipe

      at java.net.SocketOutputStream.socketWrite0(Native Method)

      at java.net.SocketOutputStream.socketWrite(Unknown Source)

      at java.net.SocketOutputStream.write(Unknown Source)

      at java.io.ObjectOutputStream$BlockDataOutputStream.drain(Unknown Source)

      at java.io.ObjectOutputStream$BlockDataOutputStream.setBlockDataMode(Unknown Source)

      at java.io.ObjectOutputStream.writeNonProxyDesc(Unknown Source)

      at java.io.ObjectOutputStream.writeClassDesc(Unknown Source)

      at java.io.ObjectOutputStream.writeOrdinaryObject(Unknown Source)

      at java.io.ObjectOutputStream.writeObject0(Unknown Source)

      at java.io.ObjectOutputStream.writeFatalException(Unknown Source)

      at java.io.ObjectOutputStream.writeObject(Unknown Source)

      at Vdb.SlaveSocket.putMessage(SlaveSocket.java:278)

      at Vdb.CollectSlaveStats.(CollectSlaveStats.java:121)
      at Vdb.Reporter.run(Reporter.java:183)

      ---------------------------------------------------------------------------------------

       

       

      And another connected question :

      The fwd operation is READ, without any writes, so if the format would have passed successfully, what would have been the correct behaviour?

      Would VDBench simply read the empty files and pass ? or would fail since they are empty?