[Disksim-users] DiskSim 4.0 - runvalid - fail - results do NOT match expected

Mon Jun 9 15:19:09 EDT 2008

Hi Ted,

You mean identical results in the sense that they are matching expected results? Or idential results to what Lei and I observe (mismatching to expected results)?

Thanks,

Cagdas

---- Original message ----
>Date: Mon, 9 Jun 2008 10:52:52 -0700
>From: Ted Wobber <wobber at microsoft.com>  
>Subject: RE: [Disksim-users] DiskSim 4.0 - runvalid - fail - results do NOT match expected  
>To: "cdirik at umd.edu" <cdirik at umd.edu>, "disksim-users at ece.cmu.edu" <disksim-users at ece.cmu.edu>
>Cc: Ted Wobber <wobber at microsoft.com>
>
>We observe virtually identical results on our Win32 port of DiskSim.
>
>Ted Wobber
>MSR Silicon Valley
>
>
>-----Original Message-----
>From: disksim-users-bounces at ece.cmu.edu [mailto:disksim-users-bounces at ece.cmu.edu] On Behalf Of Cagdas Dirik
>Sent: Sunday, June 08, 2008 2:46 PM
>To: disksim-users at ece.cmu.edu
>Subject: [Disksim-users] DiskSim 4.0 - runvalid - fail - results do NOT match expected
>
>Hi,
>
>Like Lei, when I runvalid DiskSim 4.0, I am getting mismatching results. I have
>tried this on a OS 10.4 with gcc version 4.0.1. Also tried it on a linux box and
>got the same mismatching outputs.
>
>Any ideas on what the problem might be?
>
>Thanks,
>
>Cagdas
>
>Hi,
>
>I compiled the source code of disksim 4.0 successfully on my virtual machine
>(Fedora Core 4), and ran runvalid and memsvalid files under the valid directory.
>
>The results are as follows, and it seems that,
>1) for runvalid, some simulation results are not the same as expected, please
>see the results marked in red.
>2) for memsvalid, it looks like there is no mems.g3.parv file under the valid
>directory.
>
>Thanks,
>
>Lei
>
>
>[root at smile valid]# ./runvalid
>
>These results represent actual drive validation experiments
>
>QUANTUM_QM39100TD-SW (rms should be about 0.378)
>disksim_run_simulation(): simulated 1090389 events
>rms = 0.377952
>
>SEAGATE_ST32171W (rms should be about 0.349)
>disksim_run_simulation(): simulated 1585710 events
>rms = 0.347570
>
>SEAGATE_ST34501N (rms should be about 0.318)
>disksim_run_simulation(): simulated 1591859 events
>rms = 0.317972
>
>SEAGATE_ST39102LW (rms should be about 0.107)
>disksim_run_simulation(): simulated 883217 events
>rms = 0.106906
>
>IBM_DNES-309170W (rms should be about 0.135)
>disksim_run_simulation(): simulated 2690642 events
>rms = 0.135884
>
>QUANTUM_TORNADO (rms should be about 0.159)
>disksim_run_simulation(): simulated 1094910 events
>rms = 0.267721
>
>HP_C2247_validate (rms should be about 0.090)
>disksim_run_simulation(): simulated 829410 events
>rms = 0.089931
>
>HP_C3323_validate (rms should be about 0.306)
>disksim_run_simulation(): simulated 1088847 events
>rms = 0.305653
>
>HP_C2490_validate (rms should be about 0.254)
>disksim_run_simulation(): simulated 1068808 events
>rms = 0.253762
>
>DEC_RZ26_validate (rms should be about 0.438)
>*** warning: ignoring hpl parameters for non-hpl seek type.
>disksim_run_simulation(): simulated 707184 events
>rms = 0.340367
>
>The remaining tests exercise other DiskSim components
>
>Open synthetic workload (avg. resp. should be about 47.3ms)
>disksim_run_simulation(): simulated 1044524 events
>IOdriver Response time average:         10.937386
>
>Closed synthetic workload (avg. resp. should be about 87.6ms)
>disksim_run_simulation(): simulated 571678 events
>IOdriver Response time average:         87.819135
>
>Mixed synthetic workload (avg. resp. should be about 24.4ms)
>disksim_run_simulation(): simulated 1313881 events
>IOdriver Response time average:         22.086628
>
>RAID 5 at device driver (avg. resp. should be about 22.8ms)
>disksim_run_simulation(): simulated 1974909 events
>IOdriver Response time average:         22.861326
>
>Set of disk arrays at device driver (avg. resp. should be about 33.3ms)
>disksim_run_simulation(): simulated 1895981 events
>Overall I/O System Response time average:       34.272035
>
>Memory cache at controller (avg. resp. should be about 23.0ms)
>disksim_run_simulation(): simulated 1396705 events
>IOdriver Response time average:         24.651367
>
>Cache device managed at controller (avg. resp. should be about 27.4ms)
>disksim_run_simulation(): simulated 2123707 events
>IOdriver Response time average:         28.939379
>
>Simpledisk instead of original model (avg. resp. should be about 13.5ms)
>disksim_run_simulation(): simulated 377469 events
>IOdriver Response time average:         13.711596
>3 different disks
>(avg. resps. should be about 10.951)
>disksim_run_simulation(): simulated 1044524 events
>IOdriver Response time average:         10.937386
>3 disks on separate controllers
>(avg. resps. should be about 10.951)
>disksim_run_simulation(): simulated 1044524 events
>IOdriver Response time average:         10.937386
>
>Note: this validates HP trace input, *not* the corresponding traced disk
>HP srt trace input (avg. resp should be about 48.8ms)
>disksim_run_simulation(): simulated 3422024 events
>IOdriver Response time average:         48.786646
>
>ASCII input (avg. resp should be about 13.8ms)
>disksim_run_simulation(): simulated 10754770 events
>IOdriver Response time average:         13.766948
>
>syssim: externally-controlled DiskSim (avg. resp should be about 8.9ms)
>response time: n=1000 average=8.894719 std. deviation=2.116511
>IOdriver Response time average:         8.894719
>
>
>
>[root at smile valid]# ./memsvalid
>
>G1 MEMS Device - synthetic workload (avg. resp. should be about 2.00 ms)
>disksim_run_simulation(): simulated 891324 events
>IOdriver Response time average:         2.004587
>
>G2 MEMS Device - synthetic workload (avg. resp. should be about 1.18 ms)
>disksim_run_simulation(): simulated 800016 events
>IOdriver Response time average:         1.178837
>
>G3 MEMS Device - synthetic workload (avg. resp. should be about 0.87 ms)
>*** assertion failed: in disksim_loadparams() (disksim_loadparams.c:86):
>disksim->parfile != NULL: mems.g3.parv
>./memsvalid: line 15: 11021 gave up                 ../src/disksim mems.g3.parv
>mems.g3.nospring.outv ascii 0 1 mems0 "Spring constant factor" 0.00
>
>G1 MEMS Device with 75% springs - synthetic workload (avg. resp. should be
>about 2.01 ms)
>disksim_run_simulation(): simulated 891263 events
>IOdriver Response time average:         2.013940
>
>G2 MEMS Device with 75% springs - synthetic workload (avg. resp. should be
>about 1.16 ms)
>disksim_run_simulation(): simulated 799997 events
>IOdriver Response time average:         1.158043
>
>G3 MEMS Device with 75% springs - synthetic workload (avg. resp. should be
>about 0.85 ms)
>*** assertion failed: in disksim_loadparams() (disksim_loadparams.c:86):
>disksim->parfile != NULL: mems.g3.parv
>./memsvalid: line 30: 11027 gave up         ../src/disksim mems.g3.parv
>mems.g3.outv ascii 0 1 mems0 "Spring constant factor" 0.75
>
>_______________________________________________
>Disksim-users mailing list
>Disksim-users at ece.cmu.edu
>https://sos.ece.cmu.edu/mailman/listinfo/disksim-users