WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.openjdk.jmh.util.Utils (file:/local/home/hohensee/workspaces/test/target/benchmarks.jar) to field java.io.PrintStream.charOut WARNING: Please consider reporting this to the maintainers of org.openjdk.jmh.util.Utils WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Throughput, ops/time # Benchmark: org.sample.MyBenchmark.testMethod # Run progress: 0.00% complete, ETA 00:41:40 # Fork: 1 of 5 # Warmup Iteration 1: 1797049116.895 ops/s # Warmup Iteration 2: 1796621624.417 ops/s # Warmup Iteration 3: 1753110308.520 ops/s # Warmup Iteration 4: 1748813056.088 ops/s # Warmup Iteration 5: 1752285454.673 ops/s Iteration 1: 1756569040.891 ops/s Iteration 2: 1748828920.609 ops/s Iteration 3: 1744077958.283 ops/s Iteration 4: 1750682948.288 ops/s Iteration 5: 1754719627.381 ops/s # Run progress: 4.00% complete, ETA 00:40:17 # Fork: 2 of 5 # Warmup Iteration 1: 1799062319.675 ops/s # Warmup Iteration 2: 1797160750.710 ops/s # Warmup Iteration 3: 1773683589.400 ops/s # Warmup Iteration 4: 1757643479.265 ops/s # Warmup Iteration 5: 1761929675.303 ops/s Iteration 1: 1770197771.131 ops/s Iteration 2: 1773986631.566 ops/s Iteration 3: 1777159318.312 ops/s Iteration 4: 1773659690.895 ops/s Iteration 5: 1769585703.216 ops/s # Run progress: 8.00% complete, ETA 00:38:36 # Fork: 3 of 5 # Warmup Iteration 1: 1790244251.283 ops/s # Warmup Iteration 2: 1789291223.642 ops/s # Warmup Iteration 3: 1763608338.690 ops/s # Warmup Iteration 4: 1769498788.329 ops/s # Warmup Iteration 5: 1769401578.835 ops/s Iteration 1: 1770651082.757 ops/s Iteration 2: 1782216604.672 ops/s Iteration 3: 1763892765.930 ops/s Iteration 4: 1766140905.706 ops/s Iteration 5: 1772454085.290 ops/s # Run progress: 12.00% complete, ETA 00:36:56 # Fork: 4 of 5 # Warmup Iteration 1: 1799028185.597 ops/s # Warmup Iteration 2: 1796750869.954 ops/s # Warmup Iteration 3: 1783750441.499 ops/s # Warmup Iteration 4: 1782336172.400 ops/s # Warmup Iteration 5: 1779836537.185 ops/s Iteration 1: 1780045344.383 ops/s Iteration 2: 1785973515.979 ops/s Iteration 3: 1787588446.180 ops/s Iteration 4: 1786188831.241 ops/s Iteration 5: 1783584741.847 ops/s # Run progress: 16.00% complete, ETA 00:35:15 # Fork: 5 of 5 # Warmup Iteration 1: 1793619317.937 ops/s # Warmup Iteration 2: 1797917717.489 ops/s # Warmup Iteration 3: 1753238050.848 ops/s # Warmup Iteration 4: 1758760810.405 ops/s # Warmup Iteration 5: 1753359336.656 ops/s Iteration 1: 1753808177.372 ops/s Iteration 2: 1754426416.873 ops/s Iteration 3: 1757358519.888 ops/s Iteration 4: 1749198310.281 ops/s Iteration 5: 1748180358.422 ops/s Result "org.sample.MyBenchmark.testMethod": 1766447028.696 ±(99.9%) 10331696.811 ops/s [Average] (min, avg, max) = (1744077958.283, 1766447028.696, 1787588446.180), stdev = 13792519.651 CI (99.9%): [1756115331.884, 1776778725.507] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = LBQ) # Run progress: 20.00% complete, ETA 00:33:34 # Fork: 1 of 5 # Warmup Iteration 1: 249.743 ns/op # Warmup Iteration 2: 226.518 ns/op # Warmup Iteration 3: 219.160 ns/op # Warmup Iteration 4: 214.816 ns/op # Warmup Iteration 5: 243.139 ns/op Iteration 1: 244.603 ns/op Iteration 2: 215.915 ns/op Iteration 3: 242.838 ns/op Iteration 4: 234.060 ns/op Iteration 5: 229.029 ns/op # Run progress: 24.00% complete, ETA 00:31:54 # Fork: 2 of 5 # Warmup Iteration 1: 220.957 ns/op # Warmup Iteration 2: 224.129 ns/op # Warmup Iteration 3: 212.924 ns/op # Warmup Iteration 4: 217.377 ns/op # Warmup Iteration 5: 220.888 ns/op Iteration 1: 247.263 ns/op Iteration 2: 228.879 ns/op Iteration 3: 220.768 ns/op Iteration 4: 253.307 ns/op Iteration 5: 208.520 ns/op # Run progress: 28.00% complete, ETA 00:30:13 # Fork: 3 of 5 # Warmup Iteration 1: 246.126 ns/op # Warmup Iteration 2: 232.838 ns/op # Warmup Iteration 3: 231.040 ns/op # Warmup Iteration 4: 246.692 ns/op # Warmup Iteration 5: 212.288 ns/op Iteration 1: 247.547 ns/op Iteration 2: 212.285 ns/op Iteration 3: 215.164 ns/op Iteration 4: 226.921 ns/op Iteration 5: 222.517 ns/op # Run progress: 32.00% complete, ETA 00:28:32 # Fork: 4 of 5 # Warmup Iteration 1: 247.063 ns/op # Warmup Iteration 2: 230.990 ns/op # Warmup Iteration 3: 237.824 ns/op # Warmup Iteration 4: 234.375 ns/op # Warmup Iteration 5: 234.633 ns/op Iteration 1: 219.961 ns/op Iteration 2: 208.499 ns/op Iteration 3: 239.944 ns/op Iteration 4: 241.897 ns/op Iteration 5: 212.936 ns/op # Run progress: 36.00% complete, ETA 00:26:51 # Fork: 5 of 5 # Warmup Iteration 1: 229.535 ns/op # Warmup Iteration 2: 231.284 ns/op # Warmup Iteration 3: 227.946 ns/op # Warmup Iteration 4: 224.384 ns/op # Warmup Iteration 5: 223.305 ns/op Iteration 1: 206.931 ns/op Iteration 2: 229.079 ns/op Iteration 3: 224.264 ns/op Iteration 4: 257.910 ns/op Iteration 5: 225.742 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 228.671 ±(99.9%) 11.136 ns/op [Average] (min, avg, max) = (206.931, 228.671, 257.910), stdev = 14.866 CI (99.9%): [217.535, 239.807] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = ABQ_NF) # Run progress: 40.00% complete, ETA 00:25:11 # Fork: 1 of 5 # Warmup Iteration 1: 378.576 ns/op # Warmup Iteration 2: 425.997 ns/op # Warmup Iteration 3: 452.650 ns/op # Warmup Iteration 4: 473.929 ns/op # Warmup Iteration 5: 449.365 ns/op Iteration 1: 444.143 ns/op Iteration 2: 450.265 ns/op Iteration 3: 396.495 ns/op Iteration 4: 408.726 ns/op Iteration 5: 461.393 ns/op # Run progress: 44.00% complete, ETA 00:23:30 # Fork: 2 of 5 # Warmup Iteration 1: 390.393 ns/op # Warmup Iteration 2: 401.625 ns/op # Warmup Iteration 3: 417.111 ns/op # Warmup Iteration 4: 449.693 ns/op # Warmup Iteration 5: 429.794 ns/op Iteration 1: 435.866 ns/op Iteration 2: 454.483 ns/op Iteration 3: 424.708 ns/op Iteration 4: 504.832 ns/op Iteration 5: 557.856 ns/op # Run progress: 48.00% complete, ETA 00:21:49 # Fork: 3 of 5 # Warmup Iteration 1: 352.879 ns/op # Warmup Iteration 2: 372.458 ns/op # Warmup Iteration 3: 394.315 ns/op # Warmup Iteration 4: 517.274 ns/op # Warmup Iteration 5: 417.575 ns/op Iteration 1: 367.933 ns/op Iteration 2: 451.398 ns/op Iteration 3: 425.543 ns/op Iteration 4: 422.657 ns/op Iteration 5: 459.161 ns/op # Run progress: 52.00% complete, ETA 00:20:09 # Fork: 4 of 5 # Warmup Iteration 1: 342.386 ns/op # Warmup Iteration 2: 387.937 ns/op # Warmup Iteration 3: 421.406 ns/op # Warmup Iteration 4: 418.179 ns/op # Warmup Iteration 5: 411.406 ns/op Iteration 1: 399.331 ns/op Iteration 2: 382.027 ns/op Iteration 3: 346.095 ns/op Iteration 4: 375.852 ns/op Iteration 5: 394.957 ns/op # Run progress: 56.00% complete, ETA 00:18:28 # Fork: 5 of 5 # Warmup Iteration 1: 362.108 ns/op # Warmup Iteration 2: 436.483 ns/op # Warmup Iteration 3: 445.014 ns/op # Warmup Iteration 4: 402.684 ns/op # Warmup Iteration 5: 516.372 ns/op Iteration 1: 541.804 ns/op Iteration 2: 562.627 ns/op Iteration 3: 440.027 ns/op Iteration 4: 398.248 ns/op Iteration 5: 376.442 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 435.315 ±(99.9%) 42.927 ns/op [Average] (min, avg, max) = (346.095, 435.315, 562.627), stdev = 57.307 CI (99.9%): [392.387, 478.242] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = ABQ_F) # Run progress: 60.00% complete, ETA 00:16:47 # Fork: 1 of 5 # Warmup Iteration 1: 7010.047 ns/op # Warmup Iteration 2: 6982.535 ns/op # Warmup Iteration 3: 6998.843 ns/op # Warmup Iteration 4: 7000.546 ns/op # Warmup Iteration 5: 6993.975 ns/op Iteration 1: 7025.770 ns/op Iteration 2: 6880.469 ns/op Iteration 3: 6719.565 ns/op Iteration 4: 6430.905 ns/op Iteration 5: 6368.298 ns/op # Run progress: 64.00% complete, ETA 00:15:06 # Fork: 2 of 5 # Warmup Iteration 1: 7409.875 ns/op # Warmup Iteration 2: 6873.750 ns/op # Warmup Iteration 3: 6688.272 ns/op # Warmup Iteration 4: 6579.947 ns/op # Warmup Iteration 5: 6726.063 ns/op Iteration 1: 6700.509 ns/op Iteration 2: 6670.586 ns/op Iteration 3: 6633.938 ns/op Iteration 4: 6696.494 ns/op Iteration 5: 6700.543 ns/op # Run progress: 68.00% complete, ETA 00:13:26 # Fork: 3 of 5 # Warmup Iteration 1: 7173.807 ns/op # Warmup Iteration 2: 6792.786 ns/op # Warmup Iteration 3: 6748.630 ns/op # Warmup Iteration 4: 6739.274 ns/op # Warmup Iteration 5: 6741.116 ns/op Iteration 1: 6741.298 ns/op Iteration 2: 6750.901 ns/op Iteration 3: 6764.737 ns/op Iteration 4: 6790.563 ns/op Iteration 5: 6762.947 ns/op # Run progress: 72.00% complete, ETA 00:11:45 # Fork: 4 of 5 # Warmup Iteration 1: 7729.769 ns/op # Warmup Iteration 2: 7244.551 ns/op # Warmup Iteration 3: 7057.348 ns/op # Warmup Iteration 4: 7087.987 ns/op # Warmup Iteration 5: 6737.689 ns/op Iteration 1: 6736.994 ns/op Iteration 2: 6680.352 ns/op Iteration 3: 6718.431 ns/op Iteration 4: 6746.569 ns/op Iteration 5: 6734.890 ns/op # Run progress: 76.00% complete, ETA 00:10:04 # Fork: 5 of 5 # Warmup Iteration 1: 7627.169 ns/op # Warmup Iteration 2: 7414.017 ns/op # Warmup Iteration 3: 7490.744 ns/op # Warmup Iteration 4: 6774.830 ns/op # Warmup Iteration 5: 6684.018 ns/op Iteration 1: 6559.310 ns/op Iteration 2: 6658.815 ns/op Iteration 3: 6986.001 ns/op Iteration 4: 7203.321 ns/op Iteration 5: 6755.227 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 6736.697 ±(99.9%) 125.986 ns/op [Average] (min, avg, max) = (6368.298, 6736.697, 7203.321), stdev = 168.188 CI (99.9%): [6610.711, 6862.683] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = PBQ) # Run progress: 80.00% complete, ETA 00:08:23 # Fork: 1 of 5 # Warmup Iteration 1: 408.434 ns/op # Warmup Iteration 2: 413.100 ns/op # Warmup Iteration 3: 458.265 ns/op # Warmup Iteration 4: 458.860 ns/op # Warmup Iteration 5: 465.660 ns/op Iteration 1: 472.991 ns/op Iteration 2: 478.911 ns/op Iteration 3: 468.531 ns/op Iteration 4: 450.395 ns/op Iteration 5: 460.141 ns/op # Run progress: 84.00% complete, ETA 00:06:43 # Fork: 2 of 5 # Warmup Iteration 1: 427.460 ns/op # Warmup Iteration 2: 423.014 ns/op # Warmup Iteration 3: 495.985 ns/op # Warmup Iteration 4: 503.156 ns/op # Warmup Iteration 5: 440.995 ns/op Iteration 1: 438.114 ns/op Iteration 2: 429.414 ns/op Iteration 3: 426.364 ns/op Iteration 4: 483.500 ns/op Iteration 5: 503.761 ns/op # Run progress: 88.00% complete, ETA 00:05:02 # Fork: 3 of 5 # Warmup Iteration 1: 485.425 ns/op # Warmup Iteration 2: 480.669 ns/op # Warmup Iteration 3: 463.670 ns/op # Warmup Iteration 4: 460.721 ns/op # Warmup Iteration 5: 470.208 ns/op Iteration 1: 490.928 ns/op Iteration 2: 542.044 ns/op Iteration 3: 505.050 ns/op Iteration 4: 481.796 ns/op Iteration 5: 475.459 ns/op # Run progress: 92.00% complete, ETA 00:03:21 # Fork: 4 of 5 # Warmup Iteration 1: 425.440 ns/op # Warmup Iteration 2: 413.048 ns/op # Warmup Iteration 3: 420.033 ns/op # Warmup Iteration 4: 423.833 ns/op # Warmup Iteration 5: 386.633 ns/op Iteration 1: 388.598 ns/op Iteration 2: 468.389 ns/op Iteration 3: 454.962 ns/op Iteration 4: 411.936 ns/op Iteration 5: 445.644 ns/op # Run progress: 96.00% complete, ETA 00:01:40 # Fork: 5 of 5 # Warmup Iteration 1: 475.146 ns/op # Warmup Iteration 2: 469.616 ns/op # Warmup Iteration 3: 435.210 ns/op # Warmup Iteration 4: 436.750 ns/op # Warmup Iteration 5: 444.437 ns/op Iteration 1: 444.152 ns/op Iteration 2: 415.041 ns/op Iteration 3: 414.946 ns/op Iteration 4: 443.343 ns/op Iteration 5: 450.596 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 457.800 ±(99.9%) 25.765 ns/op [Average] (min, avg, max) = (388.598, 457.800, 542.044), stdev = 34.396 CI (99.9%): [432.035, 483.565] (assumes normal distribution) # Run complete. Total time: 00:41:59 REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial experiments, perform baseline and negative tests that provide experimental control, make sure the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts. Do not assume the numbers tell you what you want them to tell. Benchmark (capacity) (type) Mode Cnt Score Error Units o.sample.MyBenchmark.testMethod N/A N/A thrpt 25 1766447028.696 ± 10331696.811 ops/s o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 LBQ avgt 25 228.671 ± 11.136 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 ABQ_NF avgt 25 435.315 ± 42.927 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 ABQ_F avgt 25 6736.697 ± 125.986 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 PBQ avgt 25 457.800 ± 25.765 ns/op