3.9% regression in scimark_server_tuned_large_LU in build s10u9_09
scimark_server_tuned_large_LU :

--------------------------------------------------------------------------------
Historical scimark_server_tuned_large_LU results on oaf341_64
--------------------------------------------------------------------------------
Build Result Status Description Related Bugs
--------------------------------------------------------------------------------
s10u9_09 647.61 RED 3.9% regression
s10u9_08 673.55 GREEN 4.1% improvement 6950536
s10u9_07 646.85 GREEN unchanged 6947025
s10u9_06 645.82 GREEN unchanged 6942751
s10u9_05 647.12 RED 3.8% regression 6938374
s10u9_04 672.72 GREEN unchanged 6934770
s10u9_02 673.09 GREEN unchanged 6926231
s10u9_01 673.7 GREEN unchanged 6916537
s10u8_08a
s10u8_08
s10u8_07 671.71 GREEN unchanged 6881975
s10u8_06
s10u8_05
s10u8_04
s10u8_03
s10u8_02
s10u8_01 674.54 GREEN unchanged 6851852
s10u7_08 674.25 GREEN unchanged 6830126
s10u7_07 ~ YELLOW Comparison not statistically significant6823785
s10u7_06 ~ YELLOW Comparison not statistically significant6826800
s10u7_05 673.85 GREEN unchanged
s10u7_04 673.57 GREEN unchanged
s10u7_03
s10u7_02
s10u7_01 674.59 GREEN unchanged
s10u6_07b 673.18 GREEN unchanged
s10u6_07a 673.97 GREEN unchanged
s10u6_07 673.06 GREEN unchanged
s10u6_06 675.34 GREEN unchanged
s10u6_05 671.42 GREEN unchanged
s10u6_04 672.95 GREEN unchanged
s10u6_03
s10u6_02
s10u6_01
s10u5_10 674.02 GREEN unchanged
s10u5_09 ~ YELLOW Comparison not statistically significant
s10u5_08
s10u5_07 ~ YELLOW Comparison not statistically significant
s10u5_06 674.14 GREEN unchanged
s10u5_05 672.98 GREEN unchanged
s10u5_05 672.98 GREEN unchanged
s10u5_04 671.76 GREEN unchanged
s10u5_03 675.05 GREEN unchanged
s10u5_02 673.4 GREEN unchanged
s10u5_01 672.72 GREEN unchanged
s10u4_12b 672.82 GREEN unchanged
s10u4_12 674.65 GREEN unchanged
s10u4_11 673.91 GREEN unchanged
s10u4_10 673.6 GREEN unchanged
s10u4_09 673.72 GREEN unchanged
s10u4_08 668.49 GREEN unchanged
s10u4_07 668.79 GREEN unchanged
s10u4_06 670.02 GREEN unchanged
s10u4_05a 668.23 GREEN unchanged
s10u4_05 669.29 GREEN unchanged
s10u4_04 670.43 GREEN 24.2% improvement
s10u4_03
s10u4_02 539.89 GREEN unchanged
s10u4_01 538.32 GREEN unchanged
s10u3_10
s10u3_09 539.16 GREEN unchanged
s10u3_08 539.23 GREEN unchanged
s10u3_07a
s10u3_07 536.85 First Result

Using s10u9_08 as baseline
7 baselines. Average is 673.54 PctStDevis 0.11%
Plot_mean: 647.61 , overall change: 3.85 %
Iteration Result Change Colour
1 647.24 -3.90 % RED
2 647.87 -3.81 % RED
3 648.82 -3.67 % RED
4 646.62 -4.00 % RED
5 645.99 -4.09 % RED
6 648.19 -3.76 % RED
7 648.50 -3.72 % RED
Number of runs: 7
With all numbers shown, overall change will be -3.85%
Previous build:s10u9_08 673.54 -0.00 % YELLOW
The found results are: 1 YELLOW, 7 RED including the old result
Std. Deviation as % from Mean is 0.16
TTest against baseline: 0.0000000000

Outliers
=========
1 very low outliers in base
1 very high outliers in base
Can't find the machine in /etc/bootparams.
Benchmark res_range: 10:-1 (not ship)
Driver Version changes...
  -sd SCSI Disk Driver 1.556 (1.556 -> 1.557)
  -mac MAC Services v1.10 (1.10 -> 1.1)
  -dld Data-Link Driver v1.6 (1.6 -> 1.7)
  -dls Data-Link Services v1.7 (1.7 -> 1.8)
  -elfexec exec module for elf 1.121 (1.121 -> 1.122)
  -fctl SunFC Transport v20100331-1.59 (1.59 -> 1.60)
  -qlc SunFC Qlogic FCA v20090929-2.32 (2.32 -> 3.00)
  -mac_ether Ethernet MAC plugin 1.1 (1.1 -> 1.2)


Detailed statistical comparison of results is available at:
http://perfwww.ireland/cgi-bin/detail.cgi?rig=oaf341_64&benchmark=scimark_server_tuned_large_LU&build=s10u9_09&base=s10u9_08&clean=FALSE

Using s10_74L2a as baseline
No Baselines
Plot_mean: 647.61 , overall change: 100.00 %
Warning: plot_per is 0.00, but overall change is 100.00. Will update later.
Iteration Result Change Colour
1 647.24
2 647.87
3 648.82
4 646.62
5 645.99
6 648.19
7 648.50
Number of runs: 7
With all numbers shown, overall change will be 0.00%
Previous build:s10u9_08 673.54
Std. Deviation as % from Mean is 0.16
TTest against baseline: 1.0000000000

Outliers
=========
Can't find the machine in /etc/bootparams.
Benchmark res_range: 10:-1 (not ship)

Detailed statistical comparison of results is available at:
http://perfwww.ireland/cgi-bin/detail.cgi?rig=oaf341_64&benchmark=scimark_server_tuned_large_LU&build=s10u9_09&base=s10_74L2a&clean=FALSE

http://perfwww.ireland/cgi-bin/publictools/shipII.cgi?&BUILD=s10u9&BNAMES=scimark_server_tuned_large_LU&tSysteM=oaf341_64

The machine is a :Xeon 2soc 4 x 1600MHz 2043 MB ram
Looking at the rig history we are jumping back and forth from ~645 to ~675.
So it look like we are jumping between two stable points.

mean change% num stddev% build
673.70 -0.00% 4 s10u9_01
673.09 -0.09% 6 0.14 s10u9_02
673.47 -0.03% 7 0.12 s10u9_03
672.72 -0.15% 6 0.13 s10u9_04
647.12 -3.95% 7 0.20 s10u9_05
645.82 -4.14% 7 0.27 s10u9_06
646.85 -3.99% 7 0.17 s10u9_07
673.55 -0.02% 7 0.11 s10u9_08
647.42 -3.90% 49 0.17 s10u9_09
646.26 -4.07% 49 0.25 s10u9_10
646.22 -4.08% 7 0.18 s10u9_11
646.62 -4.02% 4 0.09 s10u9_12
Baseline used: s10u9_01

This is corresponding exactly with the changes is major java default:

s10u9_01 java version "1.5.0_23"
s10u9_02 java version "1.5.0_23"
s10u9_03 java version "1.5.0_23"
s10u9_04 java version "1.5.0_23"
s10u9_05 java version "1.6.0_18"
s10u9_06 java version "1.6.0_19"
s10u9_07 java version "1.6.0_19"
s10u9_08 java version "1.5.0_24"
s10u9_09 java version "1.6.0_19"
s10u9_10 java version "1.6.0_19"
s10u9_11 java version "1.6.0_19"
s10u9_12 java version "1.6.0_21"

In
6938374 - 3.8% s10u9_05 scimark_server_tuned_large_LU performance regression x86
I verified the java version was the RC for the regression, so I will
assign this bug onto the java folk also.