Uploaded image for project: 'JDK'
  1. JDK
  2. JDK-4914629

2% Regression in Scimark going from Tiger b14 to Tiger b15

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Won't Fix
    • Icon: P2 P2
    • None
    • 5.0
    • hotspot
    • gc
    • sparc
    • solaris_9

      There is a 2% regression in scimark from Tiger b14 to Tiger b15 on solaris sparc and sparcv9

      http://alacrity.sfbay/nq/nes.jsp?base=344,345,346,232,236,237,238,240,241,242,472&build=327,341,342,343,231,233,234,235,229,230,471&pval=0.01

      The regression is in the Hotspot VM since running
      JDK b14/ JVM b15 has the regression
      but
      JDK b15 / JVM b14 does not.

      I'm filing this under runtime since the regression occurs whether I use client or server compiler. I understand that the bug might not necessarily be in the runtime system, but this is a good place for us to start.

      Look at the following, keeping the java/hotspot version info in mind:

      benkim@pacecar ../scimark<25>% /export/perf/b14/bin/java -server -showversion
       -Xmx256m -Xms256m jnt.scimark2.commandline -large
      java version "1.5.0-beta"
      Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0-beta-b14)
      Java HotSpot(TM) Server VM (build 1.5.0-beta-b14, mixed mode)

      Composite Score: 34.87105706605659
      FFT (1048576): 10.172599830786211
      SOR (1000x1000): 84.00534435679042
      Monte Carlo : 7.924995809392397
      Sparse matmult (N=100000, nz=1000000): 24.270003019787747
      LU (1000x1000): 47.9823423135262

      java.vendor: Sun Microsystems Inc.
      java.version: 1.5.0-beta
      os.arch: sparc
      os.name: SunOS
      os.version: 5.9
      benkim@pacecar ../scimark<26>% /export/perf/b15/bin/java -server -showversion -Xmx256m -Xms256m jnt.scimark2.commandline -large
      java version "1.5.0-beta"
      Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0-beta-b15)
      Java HotSpot(TM) Server VM (build 1.5.0-beta-b15, mixed mode)

      Composite Score: 34.12651263112886
      FFT (1048576): 10.116790931692446
      SOR (1000x1000): 83.89500819646025
      Monte Carlo : 7.540321716954931
      Sparse matmult (N=100000, nz=1000000): 22.62283495450663
      LU (1000x1000): 46.45760735603003

      java.vendor: Sun Microsystems Inc.
      java.version: 1.5.0-beta
      os.arch: sparc
      os.name: SunOS
      os.version: 5.9
      benkim@pacecar ../scimark<27>% /export/perf/b14/bin/java -server -showversion -Xmx256m -Xms256m jnt.scimark2.commandline -large
      java version "1.5.0-beta"
      Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0-beta-b14)
      Java HotSpot(TM) Server VM (build 1.5.0-beta-b15, mixed mode)

      Composite Score: 34.300143252115255
      FFT (1048576): 10.167764489882572
      SOR (1000x1000): 83.89500381771062
      Monte Carlo : 7.479811263217683
      Sparse matmult (N=100000, nz=1000000): 23.73887257990438
      LU (1000x1000): 46.21926410986102

      java.vendor: Sun Microsystems Inc.
      java.version: 1.5.0-beta
      os.arch: sparc
      os.name: SunOS
      os.version: 5.9
      benkim@pacecar ../scimark<28>% /export/perf/b15/bin/java -server -showversion -Xmx256m -Xms256m jnt.scimark2.commandline -large
      java version "1.5.0-beta"
      Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0-beta-b15)
      Java HotSpot(TM) Server VM (build 1.5.0-beta-b14, mixed mode)

      Composite Score: 34.86364164281338
      FFT (1048576): 10.148469006677269
      SOR (1000x1000): 83.93175323712153
      Monte Carlo : 8.000579865097833
      Sparse matmult (N=100000, nz=1000000): 24.25160992390436
      LU (1000x1000): 47.98579618126588

      java.vendor: Sun Microsystems Inc.
      java.version: 1.5.0-beta
      os.arch: sparc
      os.name: SunOS
      os.version: 5.9

      benkim@pacecar ../scimark<31>% /java/re/jdk/1.5.0/promoted/all/b14/binaries/solaris-sparc/bin/java -client -Xmx256m -Xms256m jnt.scimark2.commandline -large
      Composite Score: 20.714694219680784
      FFT (1048576): 8.844349175023133
      SOR (1000x1000): 48.43685374923723
      Monte Carlo : 6.213783868312761
      Sparse matmult (N=100000, nz=1000000): 16.580311331436235
      LU (1000x1000): 23.49817297439456

      java.vendor: Sun Microsystems Inc.
      java.version: 1.5.0-beta
      os.arch: sparc
      os.name: SunOS
      os.version: 5.9
      benkim@pacecar ../scimark<32>% /java/re/jdk/1.5.0/promoted/all/b15/binaries/solaris-sparc/bin/java -client -Xmx256m -Xms256m jnt.scimark2.commandline -large
      Composite Score: 20.061291753852952
      FFT (1048576): 8.76821719594394
      SOR (1000x1000): 48.7821266045375
      Monte Carlo : 6.063323542776404
      Sparse matmult (N=100000, nz=1000000): 13.245033065528547
      LU (1000x1000): 23.44775836047837

      java.vendor: Sun Microsystems Inc.
      java.version: 1.5.0-beta
      os.arch: sparc
      os.name: SunOS
      os.version: 5.9

      I think the regression might have been introduced by gc_baseline merge into main_baseline on 20030805232113.jmasa.gc_baseline_merge.


      benkim@pacecar ../scimark<10>% /export/benkim/b14/bin/java -server -showversion -Xmx256m -Xms256m jnt.scimark2.commandline -large
      java version "1.5.0-beta"
      Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0-beta-b14)
      Java HotSpot(TM) Server VM (build 20030805125744.dcubed.service_hs_merge-product, mixed mode)

      Composite Score: 34.72325779246924
      FFT (1048576): 8.527723929860075
      SOR (1000x1000): 84.33810991477773
      Monte Carlo : 7.584636894270624
      Sparse matmult (N=100000, nz=1000000): 24.27921058307135
      LU (1000x1000): 48.88660764036643

      java.vendor: Sun Microsystems Inc.
      java.version: 1.5.0-beta
      os.arch: sparc
      os.name: SunOS
      os.version: 5.9
      benkim@pacecar ../scimark<11>% /export/benkim/b14/bin/java -server -showversion -Xmx256m -Xms256m jnt.scimark2.commandline -large
      java version "1.5.0-beta"
      Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0-beta-b14)
      Java HotSpot(TM) Server VM (build 20030805232113.jmasa.gc_baseline_merge-product, mixed mode)

      Composite Score: 34.14231699562801
      FFT (1048576): 8.535209868551583
      SOR (1000x1000): 84.00534435679042
      Monte Carlo : 6.9413386909610955
      Sparse matmult (N=100000, nz=1000000): 24.042074162868193
      LU (1000x1000): 47.18761789896878

      java.vendor: Sun Microsystems Inc.
      java.version: 1.5.0-beta
      os.arch: sparc
      os.name: SunOS
      os.version: 5.9

      ###@###.### 2003-08-29

            pbk Peter Kessler
            duke J. Duke
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved:
              Imported:
              Indexed: