-
Bug
-
Resolution: Fixed
-
P3
-
fx2.1
MediaSystemTest performance benchmark show big variability when running with BigBunny videos.
This is the case for running with 1 player as well as for multiple players.
The reason is actually that on some iterations (we run the test with 2 or 3 iterations) the
video is simply frozen and as results we have almost 0 results. As result we have big variability
between test iterations.
Here is the example of running MediaSystemTest-BigBunny_vp6_1280x720_3185kb_128kb_24p in j2d pipeline:
<Result[0]: 1 results
fx.bm.util.MultiScore {
JFX_MEDIA_DECDFPS 23.998931 fps greater-is-better
JFX_MEDIA_DECODED 4320.000000 frames greater-is-better
JFX_MEDIA_RENDERED 4320.000000 frames greater-is-better
JFX_MEDIA_RNDRFPS 23.998931 fps greater-is-better
}>
<Result[1]: 1 results
fx.bm.util.MultiScore {
JFX_MEDIA_DECDFPS 0.000000 fps greater-is-better
JFX_MEDIA_DECODED 0.000000 frames greater-is-better
JFX_MEDIA_RENDERED 0.000000 frames greater-is-better
JFX_MEDIA_RNDRFPS 0.000000 fps greater-is-better
}>
<Result[2]: 1 results
fx.bm.util.MultiScore {
JFX_MEDIA_DECDFPS 23.998939 fps greater-is-better
JFX_MEDIA_DECODED 4320.000000 frames greater-is-better
JFX_MEDIA_RENDERED 4320.000000 frames greater-is-better
JFX_MEDIA_RNDRFPS 23.998939 fps greater-is-better
}>
The fact the video is frozen seems to be a functional bug.
Steps to run the benchmark:
> cd tests/performance/FXBenchmark
> ant
> cd tests/performance/MediaSystemTest
> ant
> java -Xmx256m -Dprism.order=j2d -cp "../../../import/benchmarks-2.1.1/benchmarks-2.1.1.jar;../FXBenchmark/dist/FXBenchmark.jar;./dist/MediaSystemTest.jar"
-i 10 -wt 0 -tr 20 -players 1 -file file:///<path to big_bunny_vp6_1280x720_3185kb_128kb_24p.flv>
You can download big_bunny_vp6_1280x720_3185kb_128kb_24p.flv from
http://aurora-ds.us.oracle.com:9502/fx/benchmarks2-resources/media/
The issue is easy reproducible with latest fx2.1-b12.
For me it was reproducible more often with j2d pipeline rather than with d3d.
However, according to our results the issue is not pipeline specific.
Operation system: WindowsXP, Windows7
This is the case for running with 1 player as well as for multiple players.
The reason is actually that on some iterations (we run the test with 2 or 3 iterations) the
video is simply frozen and as results we have almost 0 results. As result we have big variability
between test iterations.
Here is the example of running MediaSystemTest-BigBunny_vp6_1280x720_3185kb_128kb_24p in j2d pipeline:
<Result[0]: 1 results
fx.bm.util.MultiScore {
JFX_MEDIA_DECDFPS 23.998931 fps greater-is-better
JFX_MEDIA_DECODED 4320.000000 frames greater-is-better
JFX_MEDIA_RENDERED 4320.000000 frames greater-is-better
JFX_MEDIA_RNDRFPS 23.998931 fps greater-is-better
}>
<Result[1]: 1 results
fx.bm.util.MultiScore {
JFX_MEDIA_DECDFPS 0.000000 fps greater-is-better
JFX_MEDIA_DECODED 0.000000 frames greater-is-better
JFX_MEDIA_RENDERED 0.000000 frames greater-is-better
JFX_MEDIA_RNDRFPS 0.000000 fps greater-is-better
}>
<Result[2]: 1 results
fx.bm.util.MultiScore {
JFX_MEDIA_DECDFPS 23.998939 fps greater-is-better
JFX_MEDIA_DECODED 4320.000000 frames greater-is-better
JFX_MEDIA_RENDERED 4320.000000 frames greater-is-better
JFX_MEDIA_RNDRFPS 23.998939 fps greater-is-better
}>
The fact the video is frozen seems to be a functional bug.
Steps to run the benchmark:
> cd tests/performance/FXBenchmark
> ant
> cd tests/performance/MediaSystemTest
> ant
> java -Xmx256m -Dprism.order=j2d -cp "../../../import/benchmarks-2.1.1/benchmarks-2.1.1.jar;../FXBenchmark/dist/FXBenchmark.jar;./dist/MediaSystemTest.jar"
-i 10 -wt 0 -tr 20 -players 1 -file file:///<path to big_bunny_vp6_1280x720_3185kb_128kb_24p.flv>
You can download big_bunny_vp6_1280x720_3185kb_128kb_24p.flv from
http://aurora-ds.us.oracle.com:9502/fx/benchmarks2-resources/media/
The issue is easy reproducible with latest fx2.1-b12.
For me it was reproducible more often with j2d pipeline rather than with d3d.
However, according to our results the issue is not pipeline specific.
Operation system: WindowsXP, Windows7