WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.openjdk.jmh.util.Utils (file:/local/home/hohensee/workspaces/test/target/benchmarks.jar) to field java.io.PrintStream.charOut WARNING: Please consider reporting this to the maintainers of org.openjdk.jmh.util.Utils WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Throughput, ops/time # Benchmark: org.sample.MyBenchmark.testMethod # Run progress: 0.00% complete, ETA 00:41:40 # Fork: 1 of 5 # Warmup Iteration 1: 1791774358.240 ops/s # Warmup Iteration 2: 1801942443.248 ops/s # Warmup Iteration 3: 1746876524.225 ops/s # Warmup Iteration 4: 1747367864.554 ops/s # Warmup Iteration 5: 1735730860.052 ops/s Iteration 1: 1740413499.245 ops/s Iteration 2: 1750625856.458 ops/s Iteration 3: 1746726917.406 ops/s Iteration 4: 1748951176.072 ops/s Iteration 5: 1745170255.896 ops/s # Run progress: 4.00% complete, ETA 00:40:15 # Fork: 2 of 5 # Warmup Iteration 1: 1814283072.432 ops/s # Warmup Iteration 2: 1818649108.655 ops/s # Warmup Iteration 3: 1767539750.677 ops/s # Warmup Iteration 4: 1746415834.419 ops/s # Warmup Iteration 5: 1755344176.096 ops/s Iteration 1: 1742761019.844 ops/s Iteration 2: 1752642452.572 ops/s Iteration 3: 1742251642.133 ops/s Iteration 4: 1763028261.623 ops/s Iteration 5: 1739906228.435 ops/s # Run progress: 8.00% complete, ETA 00:38:34 # Fork: 3 of 5 # Warmup Iteration 1: 1803194327.162 ops/s # Warmup Iteration 2: 1793833961.646 ops/s # Warmup Iteration 3: 1748397116.016 ops/s # Warmup Iteration 4: 1751151482.673 ops/s # Warmup Iteration 5: 1751827669.409 ops/s Iteration 1: 1750081678.154 ops/s Iteration 2: 1747705690.011 ops/s Iteration 3: 1745528788.111 ops/s Iteration 4: 1741523548.152 ops/s Iteration 5: 1730250841.483 ops/s # Run progress: 12.00% complete, ETA 00:36:54 # Fork: 4 of 5 # Warmup Iteration 1: 1805805475.443 ops/s # Warmup Iteration 2: 1807278656.845 ops/s # Warmup Iteration 3: 1742379599.505 ops/s # Warmup Iteration 4: 1736492251.123 ops/s # Warmup Iteration 5: 1742606246.880 ops/s Iteration 1: 1747033592.318 ops/s Iteration 2: 1747727382.716 ops/s Iteration 3: 1750777312.129 ops/s Iteration 4: 1748630178.557 ops/s Iteration 5: 1746735323.897 ops/s # Run progress: 16.00% complete, ETA 00:35:13 # Fork: 5 of 5 # Warmup Iteration 1: 1801428924.939 ops/s # Warmup Iteration 2: 1805167872.088 ops/s # Warmup Iteration 3: 1745209615.025 ops/s # Warmup Iteration 4: 1744254230.052 ops/s # Warmup Iteration 5: 1750260944.207 ops/s Iteration 1: 1743458610.959 ops/s Iteration 2: 1734132901.565 ops/s Iteration 3: 1746595080.266 ops/s Iteration 4: 1745730702.337 ops/s Iteration 5: 1740200094.437 ops/s Result "org.sample.MyBenchmark.testMethod": 1745543561.391 ±(99.9%) 4729289.034 ops/s [Average] (min, avg, max) = (1730250841.483, 1745543561.391, 1763028261.623), stdev = 6313465.555 CI (99.9%): [1740814272.357, 1750272850.425] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = LBQ) # Run progress: 20.00% complete, ETA 00:33:32 # Fork: 1 of 5 # Warmup Iteration 1: 396.213 ns/op # Warmup Iteration 2: 520.476 ns/op # Warmup Iteration 3: 586.642 ns/op # Warmup Iteration 4: 576.835 ns/op # Warmup Iteration 5: 574.271 ns/op Iteration 1: 470.769 ns/op Iteration 2: 519.411 ns/op Iteration 3: 577.446 ns/op Iteration 4: 501.274 ns/op Iteration 5: 481.871 ns/op # Run progress: 24.00% complete, ETA 00:31:52 # Fork: 2 of 5 # Warmup Iteration 1: 458.409 ns/op # Warmup Iteration 2: 486.309 ns/op # Warmup Iteration 3: 505.764 ns/op # Warmup Iteration 4: 482.655 ns/op # Warmup Iteration 5: 474.903 ns/op Iteration 1: 466.986 ns/op Iteration 2: 469.954 ns/op Iteration 3: 470.216 ns/op Iteration 4: 472.575 ns/op Iteration 5: 518.705 ns/op # Run progress: 28.00% complete, ETA 00:30:11 # Fork: 3 of 5 # Warmup Iteration 1: 395.375 ns/op # Warmup Iteration 2: 475.491 ns/op # Warmup Iteration 3: 508.357 ns/op # Warmup Iteration 4: 574.583 ns/op # Warmup Iteration 5: 553.417 ns/op Iteration 1: 498.863 ns/op Iteration 2: 497.296 ns/op Iteration 3: 491.232 ns/op Iteration 4: 463.134 ns/op Iteration 5: 467.401 ns/op # Run progress: 32.00% complete, ETA 00:28:31 # Fork: 4 of 5 # Warmup Iteration 1: 466.162 ns/op # Warmup Iteration 2: 479.909 ns/op # Warmup Iteration 3: 492.539 ns/op # Warmup Iteration 4: 626.986 ns/op # Warmup Iteration 5: 645.672 ns/op Iteration 1: 625.089 ns/op Iteration 2: 603.208 ns/op Iteration 3: 498.643 ns/op Iteration 4: 530.438 ns/op Iteration 5: 607.583 ns/op # Run progress: 36.00% complete, ETA 00:26:50 # Fork: 5 of 5 # Warmup Iteration 1: 373.094 ns/op # Warmup Iteration 2: 433.593 ns/op # Warmup Iteration 3: 474.381 ns/op # Warmup Iteration 4: 541.297 ns/op # Warmup Iteration 5: 535.448 ns/op Iteration 1: 532.847 ns/op Iteration 2: 506.566 ns/op Iteration 3: 511.039 ns/op Iteration 4: 521.918 ns/op Iteration 5: 521.691 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 513.046 ±(99.9%) 34.460 ns/op [Average] (min, avg, max) = (463.134, 513.046, 625.089), stdev = 46.003 CI (99.9%): [478.586, 547.506] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = ABQ_NF) # Run progress: 40.00% complete, ETA 00:25:10 # Fork: 1 of 5 # Warmup Iteration 1: 304.421 ns/op # Warmup Iteration 2: 308.743 ns/op # Warmup Iteration 3: 313.032 ns/op # Warmup Iteration 4: 308.323 ns/op # Warmup Iteration 5: 286.193 ns/op Iteration 1: 269.380 ns/op Iteration 2: 254.956 ns/op Iteration 3: 291.298 ns/op Iteration 4: 339.616 ns/op Iteration 5: 329.778 ns/op # Run progress: 44.00% complete, ETA 00:23:29 # Fork: 2 of 5 # Warmup Iteration 1: 363.123 ns/op # Warmup Iteration 2: 342.982 ns/op # Warmup Iteration 3: 283.073 ns/op # Warmup Iteration 4: 281.540 ns/op # Warmup Iteration 5: 304.297 ns/op Iteration 1: 296.371 ns/op Iteration 2: 272.256 ns/op Iteration 3: 288.821 ns/op Iteration 4: 349.938 ns/op Iteration 5: 306.673 ns/op # Run progress: 48.00% complete, ETA 00:21:48 # Fork: 3 of 5 # Warmup Iteration 1: 268.112 ns/op # Warmup Iteration 2: 278.106 ns/op # Warmup Iteration 3: 321.790 ns/op # Warmup Iteration 4: 318.636 ns/op # Warmup Iteration 5: 334.053 ns/op Iteration 1: 332.574 ns/op Iteration 2: 329.655 ns/op Iteration 3: 300.136 ns/op Iteration 4: 249.140 ns/op Iteration 5: 261.550 ns/op # Run progress: 52.00% complete, ETA 00:20:08 # Fork: 4 of 5 # Warmup Iteration 1: 289.596 ns/op # Warmup Iteration 2: 327.677 ns/op # Warmup Iteration 3: 327.243 ns/op # Warmup Iteration 4: 342.986 ns/op # Warmup Iteration 5: 345.087 ns/op Iteration 1: 248.775 ns/op Iteration 2: 251.584 ns/op Iteration 3: 299.235 ns/op Iteration 4: 300.347 ns/op Iteration 5: 308.319 ns/op # Run progress: 56.00% complete, ETA 00:18:27 # Fork: 5 of 5 # Warmup Iteration 1: 314.503 ns/op # Warmup Iteration 2: 312.798 ns/op # Warmup Iteration 3: 314.434 ns/op # Warmup Iteration 4: 310.193 ns/op # Warmup Iteration 5: 295.722 ns/op Iteration 1: 312.256 ns/op Iteration 2: 385.010 ns/op Iteration 3: 360.811 ns/op Iteration 4: 290.205 ns/op Iteration 5: 285.361 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 300.562 ±(99.9%) 27.080 ns/op [Average] (min, avg, max) = (248.775, 300.562, 385.010), stdev = 36.151 CI (99.9%): [273.482, 327.642] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = ABQ_F) # Run progress: 60.00% complete, ETA 00:16:46 # Fork: 1 of 5 # Warmup Iteration 1: 7378.724 ns/op # Warmup Iteration 2: 7214.667 ns/op # Warmup Iteration 3: 7064.801 ns/op # Warmup Iteration 4: 7822.316 ns/op # Warmup Iteration 5: 10623.824 ns/op Iteration 1: 10604.167 ns/op Iteration 2: 10608.079 ns/op Iteration 3: 10622.977 ns/op Iteration 4: 10475.678 ns/op Iteration 5: 10486.189 ns/op # Run progress: 64.00% complete, ETA 00:15:06 # Fork: 2 of 5 # Warmup Iteration 1: 7305.280 ns/op # Warmup Iteration 2: 6855.987 ns/op # Warmup Iteration 3: 6732.162 ns/op # Warmup Iteration 4: 6780.590 ns/op # Warmup Iteration 5: 6677.900 ns/op Iteration 1: 6769.813 ns/op Iteration 2: 6747.997 ns/op Iteration 3: 6622.231 ns/op Iteration 4: 6630.949 ns/op Iteration 5: 6541.480 ns/op # Run progress: 68.00% complete, ETA 00:13:25 # Fork: 3 of 5 # Warmup Iteration 1: 7328.199 ns/op # Warmup Iteration 2: 6830.225 ns/op # Warmup Iteration 3: 6781.790 ns/op # Warmup Iteration 4: 6879.556 ns/op # Warmup Iteration 5: 6921.162 ns/op Iteration 1: 6789.008 ns/op Iteration 2: 6681.560 ns/op Iteration 3: 6832.608 ns/op Iteration 4: 6838.745 ns/op Iteration 5: 6771.195 ns/op # Run progress: 72.00% complete, ETA 00:11:44 # Fork: 4 of 5 # Warmup Iteration 1: 7165.463 ns/op # Warmup Iteration 2: 6962.211 ns/op # Warmup Iteration 3: 7041.247 ns/op # Warmup Iteration 4: 7123.423 ns/op # Warmup Iteration 5: 7093.355 ns/op Iteration 1: 7066.552 ns/op Iteration 2: 7064.408 ns/op Iteration 3: 6952.934 ns/op Iteration 4: 7103.015 ns/op Iteration 5: 7109.369 ns/op # Run progress: 76.00% complete, ETA 00:10:04 # Fork: 5 of 5 # Warmup Iteration 1: 7355.604 ns/op # Warmup Iteration 2: 7148.860 ns/op # Warmup Iteration 3: 7113.994 ns/op # Warmup Iteration 4: 7100.514 ns/op # Warmup Iteration 5: 7050.468 ns/op Iteration 1: 7026.363 ns/op Iteration 2: 7032.417 ns/op Iteration 3: 8701.763 ns/op Iteration 4: 10635.908 ns/op Iteration 5: 10625.408 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 7973.633 ±(99.9%) 1277.665 ns/op [Average] (min, avg, max) = (6541.480, 7973.633, 10635.908), stdev = 1705.646 CI (99.9%): [6695.967, 9251.298] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = PBQ) # Run progress: 80.00% complete, ETA 00:08:23 # Fork: 1 of 5 # Warmup Iteration 1: 389.304 ns/op # Warmup Iteration 2: 385.721 ns/op # Warmup Iteration 3: 383.895 ns/op # Warmup Iteration 4: 404.826 ns/op # Warmup Iteration 5: 403.301 ns/op Iteration 1: 448.819 ns/op Iteration 2: 574.586 ns/op Iteration 3: 506.753 ns/op Iteration 4: 557.726 ns/op Iteration 5: 452.478 ns/op # Run progress: 84.00% complete, ETA 00:06:42 # Fork: 2 of 5 # Warmup Iteration 1: 392.048 ns/op # Warmup Iteration 2: 393.339 ns/op # Warmup Iteration 3: 385.992 ns/op # Warmup Iteration 4: 391.577 ns/op # Warmup Iteration 5: 394.700 ns/op Iteration 1: 454.671 ns/op Iteration 2: 530.923 ns/op Iteration 3: 530.707 ns/op Iteration 4: 460.582 ns/op Iteration 5: 344.470 ns/op # Run progress: 88.00% complete, ETA 00:05:02 # Fork: 3 of 5 # Warmup Iteration 1: 461.846 ns/op # Warmup Iteration 2: 430.198 ns/op # Warmup Iteration 3: 429.046 ns/op # Warmup Iteration 4: 407.577 ns/op # Warmup Iteration 5: 410.132 ns/op Iteration 1: 420.014 ns/op Iteration 2: 427.823 ns/op Iteration 3: 428.844 ns/op Iteration 4: 433.164 ns/op Iteration 5: 459.523 ns/op # Run progress: 92.00% complete, ETA 00:03:21 # Fork: 4 of 5 # Warmup Iteration 1: 393.927 ns/op # Warmup Iteration 2: 393.032 ns/op # Warmup Iteration 3: 378.908 ns/op # Warmup Iteration 4: 363.019 ns/op # Warmup Iteration 5: 362.808 ns/op Iteration 1: 393.512 ns/op Iteration 2: 414.106 ns/op Iteration 3: 422.270 ns/op Iteration 4: 355.341 ns/op Iteration 5: 350.686 ns/op # Run progress: 96.00% complete, ETA 00:01:40 # Fork: 5 of 5 # Warmup Iteration 1: 368.275 ns/op # Warmup Iteration 2: 355.791 ns/op # Warmup Iteration 3: 352.632 ns/op # Warmup Iteration 4: 357.817 ns/op # Warmup Iteration 5: 357.279 ns/op Iteration 1: 423.453 ns/op Iteration 2: 432.875 ns/op Iteration 3: 428.418 ns/op Iteration 4: 354.623 ns/op Iteration 5: 354.358 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 438.429 ±(99.9%) 47.704 ns/op [Average] (min, avg, max) = (344.470, 438.429, 574.586), stdev = 63.683 CI (99.9%): [390.725, 486.133] (assumes normal distribution) # Run complete. Total time: 00:41:57 REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial experiments, perform baseline and negative tests that provide experimental control, make sure the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts. Do not assume the numbers tell you what you want them to tell. Benchmark (capacity) (type) Mode Cnt Score Error Units o.sample.MyBenchmark.testMethod N/A N/A thrpt 25 1745543561.391 ± 4729289.034 ops/s o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 LBQ avgt 25 513.046 ± 34.460 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 ABQ_NF avgt 25 300.562 ± 27.080 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 ABQ_F avgt 25 7973.633 ± 1277.665 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 PBQ avgt 25 438.429 ± 47.704 ns/op