WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.openjdk.jmh.util.Utils (file:/local/home/hohensee/workspaces/test/target/benchmarks.jar) to field java.io.PrintStream.charOut WARNING: Please consider reporting this to the maintainers of org.openjdk.jmh.util.Utils WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Throughput, ops/time # Benchmark: org.sample.MyBenchmark.testMethod # Run progress: 0.00% complete, ETA 00:41:40 # Fork: 1 of 5 # Warmup Iteration 1: 1807685050.267 ops/s # Warmup Iteration 2: 1811093841.981 ops/s # Warmup Iteration 3: 1731714298.839 ops/s # Warmup Iteration 4: 1740717159.070 ops/s # Warmup Iteration 5: 1740433989.988 ops/s Iteration 1: 1734962604.292 ops/s Iteration 2: 1739827743.977 ops/s Iteration 3: 1740858670.522 ops/s Iteration 4: 1744684499.057 ops/s Iteration 5: 1742828871.545 ops/s # Run progress: 4.00% complete, ETA 00:40:11 # Fork: 2 of 5 # Warmup Iteration 1: 1805618849.323 ops/s # Warmup Iteration 2: 1802960797.594 ops/s # Warmup Iteration 3: 1738814590.069 ops/s # Warmup Iteration 4: 1732252137.101 ops/s # Warmup Iteration 5: 1746483330.824 ops/s Iteration 1: 1751547352.581 ops/s Iteration 2: 1742966342.328 ops/s Iteration 3: 1745737297.514 ops/s Iteration 4: 1745961576.301 ops/s Iteration 5: 1748346901.641 ops/s # Run progress: 8.00% complete, ETA 00:38:30 # Fork: 3 of 5 # Warmup Iteration 1: 1800193617.646 ops/s # Warmup Iteration 2: 1813278322.722 ops/s # Warmup Iteration 3: 1741338274.434 ops/s # Warmup Iteration 4: 1727111275.095 ops/s # Warmup Iteration 5: 1749182904.384 ops/s Iteration 1: 1743708114.141 ops/s Iteration 2: 1750262371.960 ops/s Iteration 3: 1755247204.402 ops/s Iteration 4: 1746249568.407 ops/s Iteration 5: 1746578166.118 ops/s # Run progress: 12.00% complete, ETA 00:36:49 # Fork: 4 of 5 # Warmup Iteration 1: 1794309611.443 ops/s # Warmup Iteration 2: 1802186490.713 ops/s # Warmup Iteration 3: 1798886138.891 ops/s # Warmup Iteration 4: 1801939244.535 ops/s # Warmup Iteration 5: 1803267415.139 ops/s Iteration 1: 1804449126.752 ops/s Iteration 2: 1797996475.525 ops/s Iteration 3: 1808233337.113 ops/s Iteration 4: 1813890817.313 ops/s Iteration 5: 1805458089.692 ops/s # Run progress: 16.00% complete, ETA 00:35:09 # Fork: 5 of 5 # Warmup Iteration 1: 1803867579.899 ops/s # Warmup Iteration 2: 1808832313.522 ops/s # Warmup Iteration 3: 1741507044.373 ops/s # Warmup Iteration 4: 1747760945.063 ops/s # Warmup Iteration 5: 1751170860.084 ops/s Iteration 1: 1757324621.863 ops/s Iteration 2: 1746211853.553 ops/s Iteration 3: 1739702731.199 ops/s Iteration 4: 1747058083.676 ops/s Iteration 5: 1758847451.530 ops/s Result "org.sample.MyBenchmark.testMethod": 1758357594.920 ±(99.9%) 18731201.939 ops/s [Average] (min, avg, max) = (1734962604.292, 1758357594.920, 1813890817.313), stdev = 25005618.684 CI (99.9%): [1739626392.981, 1777088796.859] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = LBQ) # Run progress: 20.00% complete, ETA 00:33:28 # Fork: 1 of 5 # Warmup Iteration 1: 461.801 ns/op # Warmup Iteration 2: 497.257 ns/op # Warmup Iteration 3: 566.811 ns/op # Warmup Iteration 4: 522.897 ns/op # Warmup Iteration 5: 502.640 ns/op Iteration 1: 533.990 ns/op Iteration 2: 534.208 ns/op Iteration 3: 534.139 ns/op Iteration 4: 568.546 ns/op Iteration 5: 586.255 ns/op # Run progress: 24.00% complete, ETA 00:31:48 # Fork: 2 of 5 # Warmup Iteration 1: 452.465 ns/op # Warmup Iteration 2: 458.895 ns/op # Warmup Iteration 3: 481.237 ns/op # Warmup Iteration 4: 483.331 ns/op # Warmup Iteration 5: 482.036 ns/op Iteration 1: 483.611 ns/op Iteration 2: 497.757 ns/op Iteration 3: 517.206 ns/op Iteration 4: 566.589 ns/op Iteration 5: 589.532 ns/op # Run progress: 28.00% complete, ETA 00:30:08 # Fork: 3 of 5 # Warmup Iteration 1: 430.413 ns/op # Warmup Iteration 2: 513.966 ns/op # Warmup Iteration 3: 605.743 ns/op # Warmup Iteration 4: 490.046 ns/op # Warmup Iteration 5: 441.601 ns/op Iteration 1: 461.082 ns/op Iteration 2: 476.488 ns/op Iteration 3: 507.634 ns/op Iteration 4: 612.183 ns/op Iteration 5: 575.989 ns/op # Run progress: 32.00% complete, ETA 00:28:28 # Fork: 4 of 5 # Warmup Iteration 1: 469.613 ns/op # Warmup Iteration 2: 478.143 ns/op # Warmup Iteration 3: 517.962 ns/op # Warmup Iteration 4: 589.466 ns/op # Warmup Iteration 5: 615.706 ns/op Iteration 1: 571.864 ns/op Iteration 2: 559.555 ns/op Iteration 3: 482.127 ns/op Iteration 4: 489.601 ns/op Iteration 5: 497.550 ns/op # Run progress: 36.00% complete, ETA 00:26:47 # Fork: 5 of 5 # Warmup Iteration 1: 438.804 ns/op # Warmup Iteration 2: 443.524 ns/op # Warmup Iteration 3: 407.546 ns/op # Warmup Iteration 4: 517.006 ns/op # Warmup Iteration 5: 454.052 ns/op Iteration 1: 437.723 ns/op Iteration 2: 507.299 ns/op Iteration 3: 580.300 ns/op Iteration 4: 625.950 ns/op Iteration 5: 500.746 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 531.917 ±(99.9%) 37.158 ns/op [Average] (min, avg, max) = (437.723, 531.917, 625.950), stdev = 49.605 CI (99.9%): [494.759, 569.075] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = ABQ_NF) # Run progress: 40.00% complete, ETA 00:25:07 # Fork: 1 of 5 # Warmup Iteration 1: 259.086 ns/op # Warmup Iteration 2: 258.828 ns/op # Warmup Iteration 3: 281.063 ns/op # Warmup Iteration 4: 281.079 ns/op # Warmup Iteration 5: 281.984 ns/op Iteration 1: 269.556 ns/op Iteration 2: 250.769 ns/op Iteration 3: 267.966 ns/op Iteration 4: 286.184 ns/op Iteration 5: 289.157 ns/op # Run progress: 44.00% complete, ETA 00:23:26 # Fork: 2 of 5 # Warmup Iteration 1: 266.657 ns/op # Warmup Iteration 2: 263.539 ns/op # Warmup Iteration 3: 321.056 ns/op # Warmup Iteration 4: 324.188 ns/op # Warmup Iteration 5: 308.905 ns/op Iteration 1: 308.286 ns/op Iteration 2: 355.447 ns/op Iteration 3: 356.423 ns/op Iteration 4: 318.238 ns/op Iteration 5: 310.167 ns/op # Run progress: 48.00% complete, ETA 00:21:46 # Fork: 3 of 5 # Warmup Iteration 1: 261.733 ns/op # Warmup Iteration 2: 261.480 ns/op # Warmup Iteration 3: 237.245 ns/op # Warmup Iteration 4: 238.056 ns/op # Warmup Iteration 5: 240.973 ns/op Iteration 1: 256.084 ns/op Iteration 2: 271.865 ns/op Iteration 3: 249.590 ns/op Iteration 4: 239.686 ns/op Iteration 5: 299.410 ns/op # Run progress: 52.00% complete, ETA 00:20:05 # Fork: 4 of 5 # Warmup Iteration 1: 270.769 ns/op # Warmup Iteration 2: 262.741 ns/op # Warmup Iteration 3: 278.711 ns/op # Warmup Iteration 4: 279.568 ns/op # Warmup Iteration 5: 292.230 ns/op Iteration 1: 282.092 ns/op Iteration 2: 264.972 ns/op Iteration 3: 284.501 ns/op Iteration 4: 303.609 ns/op Iteration 5: 299.474 ns/op # Run progress: 56.00% complete, ETA 00:18:25 # Fork: 5 of 5 # Warmup Iteration 1: 286.977 ns/op # Warmup Iteration 2: 285.804 ns/op # Warmup Iteration 3: 307.132 ns/op # Warmup Iteration 4: 305.034 ns/op # Warmup Iteration 5: 245.904 ns/op Iteration 1: 263.559 ns/op Iteration 2: 330.129 ns/op Iteration 3: 321.063 ns/op Iteration 4: 305.288 ns/op Iteration 5: 299.452 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 291.319 ±(99.9%) 23.175 ns/op [Average] (min, avg, max) = (239.686, 291.319, 356.423), stdev = 30.938 CI (99.9%): [268.144, 314.494] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = ABQ_F) # Run progress: 60.00% complete, ETA 00:16:44 # Fork: 1 of 5 # Warmup Iteration 1: 8401.803 ns/op # Warmup Iteration 2: 10612.327 ns/op # Warmup Iteration 3: 10520.421 ns/op # Warmup Iteration 4: 10470.724 ns/op # Warmup Iteration 5: 10418.623 ns/op Iteration 1: 10433.311 ns/op Iteration 2: 10448.641 ns/op Iteration 3: 10409.599 ns/op Iteration 4: 10392.256 ns/op Iteration 5: 10359.075 ns/op # Run progress: 64.00% complete, ETA 00:15:04 # Fork: 2 of 5 # Warmup Iteration 1: 6949.393 ns/op # Warmup Iteration 2: 10605.450 ns/op # Warmup Iteration 3: 10392.299 ns/op # Warmup Iteration 4: 10387.512 ns/op # Warmup Iteration 5: 10404.852 ns/op Iteration 1: 10453.631 ns/op Iteration 2: 10419.765 ns/op Iteration 3: 10392.575 ns/op Iteration 4: 10392.015 ns/op Iteration 5: 10399.364 ns/op # Run progress: 68.00% complete, ETA 00:13:23 # Fork: 3 of 5 # Warmup Iteration 1: 7281.238 ns/op # Warmup Iteration 2: 7588.608 ns/op # Warmup Iteration 3: 7402.912 ns/op # Warmup Iteration 4: 7376.524 ns/op # Warmup Iteration 5: 7362.709 ns/op Iteration 1: 7217.604 ns/op Iteration 2: 8995.508 ns/op Iteration 3: 10330.971 ns/op Iteration 4: 10374.523 ns/op Iteration 5: 10403.733 ns/op # Run progress: 72.00% complete, ETA 00:11:43 # Fork: 4 of 5 # Warmup Iteration 1: 6944.652 ns/op # Warmup Iteration 2: 7404.199 ns/op # Warmup Iteration 3: 7528.390 ns/op # Warmup Iteration 4: 9589.588 ns/op # Warmup Iteration 5: 7695.915 ns/op Iteration 1: 7046.721 ns/op Iteration 2: 6985.395 ns/op Iteration 3: 6982.110 ns/op Iteration 4: 6975.999 ns/op Iteration 5: 6976.887 ns/op # Run progress: 76.00% complete, ETA 00:10:02 # Fork: 5 of 5 # Warmup Iteration 1: 7039.193 ns/op # Warmup Iteration 2: 7141.217 ns/op # Warmup Iteration 3: 6857.564 ns/op # Warmup Iteration 4: 6918.808 ns/op # Warmup Iteration 5: 6754.120 ns/op Iteration 1: 6765.987 ns/op Iteration 2: 6673.742 ns/op Iteration 3: 6705.554 ns/op Iteration 4: 6965.683 ns/op Iteration 5: 6873.340 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 8814.959 ±(99.9%) 1300.188 ns/op [Average] (min, avg, max) = (6673.742, 8814.959, 10453.631), stdev = 1735.714 CI (99.9%): [7514.772, 10115.147] (assumes normal distribution) # JMH version: 1.27 # VM version: JDK 11.0.11-internal, OpenJDK 64-Bit Server VM, 11.0.11-internal+0-adhoc.hohensee.jdk11u-dev # VM invoker: /local/home/hohensee/workspaces/jdk11u-dev/build/linux-x86_64-normal-server-release/jdk/bin/java # VM options: # JMH blackhole mode: full blackhole + dont-inline hint # Warmup: 5 iterations, 10 s each # Measurement: 5 iterations, 10 s each # Timeout: 10 min per iteration # Threads: 1 thread, will synchronize iterations # Benchmark mode: Average time, time/op # Benchmark: org.openjdk.bench.java.util.concurrent.ProducerConsumer.test # Parameters: (capacity = 100, type = PBQ) # Run progress: 80.00% complete, ETA 00:08:22 # Fork: 1 of 5 # Warmup Iteration 1: 393.903 ns/op # Warmup Iteration 2: 369.513 ns/op # Warmup Iteration 3: 370.023 ns/op # Warmup Iteration 4: 390.120 ns/op # Warmup Iteration 5: 390.642 ns/op Iteration 1: 373.697 ns/op Iteration 2: 356.141 ns/op Iteration 3: 355.561 ns/op Iteration 4: 410.442 ns/op Iteration 5: 426.689 ns/op # Run progress: 84.00% complete, ETA 00:06:41 # Fork: 2 of 5 # Warmup Iteration 1: 437.564 ns/op # Warmup Iteration 2: 440.938 ns/op # Warmup Iteration 3: 437.711 ns/op # Warmup Iteration 4: 438.075 ns/op # Warmup Iteration 5: 435.837 ns/op Iteration 1: 437.546 ns/op Iteration 2: 449.704 ns/op Iteration 3: 450.240 ns/op Iteration 4: 438.735 ns/op Iteration 5: 400.339 ns/op # Run progress: 88.00% complete, ETA 00:05:01 # Fork: 3 of 5 # Warmup Iteration 1: 414.030 ns/op # Warmup Iteration 2: 412.442 ns/op # Warmup Iteration 3: 408.124 ns/op # Warmup Iteration 4: 403.669 ns/op # Warmup Iteration 5: 412.441 ns/op Iteration 1: 408.117 ns/op Iteration 2: 406.281 ns/op Iteration 3: 404.417 ns/op Iteration 4: 412.945 ns/op Iteration 5: 425.315 ns/op # Run progress: 92.00% complete, ETA 00:03:20 # Fork: 4 of 5 # Warmup Iteration 1: 388.304 ns/op # Warmup Iteration 2: 385.996 ns/op # Warmup Iteration 3: 387.454 ns/op # Warmup Iteration 4: 374.966 ns/op # Warmup Iteration 5: 375.783 ns/op Iteration 1: 392.844 ns/op Iteration 2: 416.451 ns/op Iteration 3: 418.084 ns/op Iteration 4: 391.071 ns/op Iteration 5: 383.701 ns/op # Run progress: 96.00% complete, ETA 00:01:40 # Fork: 5 of 5 # Warmup Iteration 1: 402.106 ns/op # Warmup Iteration 2: 413.642 ns/op # Warmup Iteration 3: 410.592 ns/op # Warmup Iteration 4: 356.632 ns/op # Warmup Iteration 5: 357.103 ns/op Iteration 1: 359.944 ns/op Iteration 2: 364.750 ns/op Iteration 3: 364.683 ns/op Iteration 4: 418.505 ns/op Iteration 5: 445.415 ns/op Result "org.openjdk.bench.java.util.concurrent.ProducerConsumer.test": 404.465 ±(99.9%) 22.287 ns/op [Average] (min, avg, max) = (355.561, 404.465, 450.240), stdev = 29.752 CI (99.9%): [382.178, 426.752] (assumes normal distribution) # Run complete. Total time: 00:41:52 REMEMBER: The numbers below are just data. To gain reusable insights, you need to follow up on why the numbers are the way they are. Use profilers (see -prof, -lprof), design factorial experiments, perform baseline and negative tests that provide experimental control, make sure the benchmarking environment is safe on JVM/OS/HW level, ask for reviews from the domain experts. Do not assume the numbers tell you what you want them to tell. Benchmark (capacity) (type) Mode Cnt Score Error Units o.sample.MyBenchmark.testMethod N/A N/A thrpt 25 1758357594.920 ± 18731201.939 ops/s o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 LBQ avgt 25 531.917 ± 37.158 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 ABQ_NF avgt 25 291.319 ± 23.175 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 ABQ_F avgt 25 8814.959 ± 1300.188 ns/op o.openjdk.bench.java.util.concurrent.ProducerConsumer.test 100 PBQ avgt 25 404.465 ± 22.287 ns/op