[Disksim-users] DiskSim 4.0 - runvalid - fail - results do NOT match expected

[Jiri Schindler]

Hello,

we have fixed the runvalid mismatches and updated the DiskSim 4.0 tar  
balls on the web site.

By mistake, I included the runvalid values for previous disksim  
releases rather than values calibrated for DiskSim 4.0. The  
discrepancy for some of the runs is caused by the order in which  
modules such as diskmodel are loaded when disksim is started and the  
resulting change to the random generator seed.

Jiri Schindler

On Jun 8, 2008, at 5:46 PM, Cagdas Dirik wrote:

> Hi,
>
> Like Lei, when I runvalid DiskSim 4.0, I am getting mismatching  
> results. I have
> tried this on a OS 10.4 with gcc version 4.0.1. Also tried it on a  
> linux box and
> got the same mismatching outputs.
>
> Any ideas on what the problem might be?
>
> Thanks,
>
> Cagdas
>
> Hi,
>
> I compiled the source code of disksim 4.0 successfully on my virtual  
> machine
> (Fedora Core 4), and ran runvalid and memsvalid files under the  
> valid directory.
>
> The results are as follows, and it seems that,
> 1) for runvalid, some simulation results are not the same as  
> expected, please
> see the results marked in red.
> 2) for memsvalid, it looks like there is no mems.g3.parv file under  
> the valid
> directory.
>
> Thanks,
>
> Lei
>
>
> [root at smile valid]# ./runvalid
>
> These results represent actual drive validation experiments
>
> QUANTUM_QM39100TD-SW (rms should be about 0.378)
> disksim_run_simulation(): simulated 1090389 events
> rms = 0.377952
>
> SEAGATE_ST32171W (rms should be about 0.349)
> disksim_run_simulation(): simulated 1585710 events
> rms = 0.347570
>
> SEAGATE_ST34501N (rms should be about 0.318)
> disksim_run_simulation(): simulated 1591859 events
> rms = 0.317972
>
> SEAGATE_ST39102LW (rms should be about 0.107)
> disksim_run_simulation(): simulated 883217 events
> rms = 0.106906
>
> IBM_DNES-309170W (rms should be about 0.135)
> disksim_run_simulation(): simulated 2690642 events
> rms = 0.135884
>
> QUANTUM_TORNADO (rms should be about 0.159)
> disksim_run_simulation(): simulated 1094910 events
> rms = 0.267721
>
> HP_C2247_validate (rms should be about 0.090)
> disksim_run_simulation(): simulated 829410 events
> rms = 0.089931
>
> HP_C3323_validate (rms should be about 0.306)
> disksim_run_simulation(): simulated 1088847 events
> rms = 0.305653
>
> HP_C2490_validate (rms should be about 0.254)
> disksim_run_simulation(): simulated 1068808 events
> rms = 0.253762
>
> DEC_RZ26_validate (rms should be about 0.438)
> *** warning: ignoring hpl parameters for non-hpl seek type.
> disksim_run_simulation(): simulated 707184 events
> rms = 0.340367
>
> The remaining tests exercise other DiskSim components
>
> Open synthetic workload (avg. resp. should be about 47.3ms)
> disksim_run_simulation(): simulated 1044524 events
> IOdriver Response time average:         10.937386
>
> Closed synthetic workload (avg. resp. should be about 87.6ms)
> disksim_run_simulation(): simulated 571678 events
> IOdriver Response time average:         87.819135
>
> Mixed synthetic workload (avg. resp. should be about 24.4ms)
> disksim_run_simulation(): simulated 1313881 events
> IOdriver Response time average:         22.086628
>
> RAID 5 at device driver (avg. resp. should be about 22.8ms)
> disksim_run_simulation(): simulated 1974909 events
> IOdriver Response time average:         22.861326
>
> Set of disk arrays at device driver (avg. resp. should be about  
> 33.3ms)
> disksim_run_simulation(): simulated 1895981 events
> Overall I/O System Response time average:       34.272035
>
> Memory cache at controller (avg. resp. should be about 23.0ms)
> disksim_run_simulation(): simulated 1396705 events
> IOdriver Response time average:         24.651367
>
> Cache device managed at controller (avg. resp. should be about 27.4ms)
> disksim_run_simulation(): simulated 2123707 events
> IOdriver Response time average:         28.939379
>
> Simpledisk instead of original model (avg. resp. should be about  
> 13.5ms)
> disksim_run_simulation(): simulated 377469 events
> IOdriver Response time average:         13.711596
> 3 different disks
> (avg. resps. should be about 10.951)
> disksim_run_simulation(): simulated 1044524 events
> IOdriver Response time average:         10.937386
> 3 disks on separate controllers
> (avg. resps. should be about 10.951)
> disksim_run_simulation(): simulated 1044524 events
> IOdriver Response time average:         10.937386
>
> Note: this validates HP trace input, *not* the corresponding traced  
> disk
> HP srt trace input (avg. resp should be about 48.8ms)
> disksim_run_simulation(): simulated 3422024 events
> IOdriver Response time average:         48.786646
>
> ASCII input (avg. resp should be about 13.8ms)
> disksim_run_simulation(): simulated 10754770 events
> IOdriver Response time average:         13.766948
>
> syssim: externally-controlled DiskSim (avg. resp should be about  
> 8.9ms)
> response time: n=1000 average=8.894719 std. deviation=2.116511
> IOdriver Response time average:         8.894719
>
>
>
> [root at smile valid]# ./memsvalid
>
> G1 MEMS Device - synthetic workload (avg. resp. should be about 2.00  
> ms)
> disksim_run_simulation(): simulated 891324 events
> IOdriver Response time average:         2.004587
>
> G2 MEMS Device - synthetic workload (avg. resp. should be about 1.18  
> ms)
> disksim_run_simulation(): simulated 800016 events
> IOdriver Response time average:         1.178837
>
> G3 MEMS Device - synthetic workload (avg. resp. should be about 0.87  
> ms)
> *** assertion failed: in disksim_loadparams() (disksim_loadparams.c: 
> 86):
> disksim->parfile != NULL: mems.g3.parv
> ./memsvalid: line 15: 11021 gave up                 ../src/disksim  
> mems.g3.parv
> mems.g3.nospring.outv ascii 0 1 mems0 "Spring constant factor" 0.00
>
> G1 MEMS Device with 75% springs - synthetic workload (avg. resp.  
> should be
> about 2.01 ms)
> disksim_run_simulation(): simulated 891263 events
> IOdriver Response time average:         2.013940
>
> G2 MEMS Device with 75% springs - synthetic workload (avg. resp.  
> should be
> about 1.16 ms)
> disksim_run_simulation(): simulated 799997 events
> IOdriver Response time average:         1.158043
>
> G3 MEMS Device with 75% springs - synthetic workload (avg. resp.  
> should be
> about 0.85 ms)
> *** assertion failed: in disksim_loadparams() (disksim_loadparams.c: 
> 86):
> disksim->parfile != NULL: mems.g3.parv
> ./memsvalid: line 30: 11027 gave up         ../src/disksim  
> mems.g3.parv
> mems.g3.outv ascii 0 1 mems0 "Spring constant factor" 0.75
>
> _______________________________________________
> Disksim-users mailing list
> Disksim-users at ece.cmu.edu
> https://sos.ece.cmu.edu/mailman/listinfo/disksim-users