FULL PRODUCT VERSION :
sdk 1.6.0_29, JRE 7

ADDITIONAL OS VERSION INFORMATION :
Win7 (does not matter)

A DESCRIPTION OF THE PROBLEM :
When the applet is not signed a security exception is thrown when opening a multicast socket. When the applet is signed the security exception is not thrown. So far so good. But when the applet is signed and the certificate will not be trusted (hitting the cancel button), the security exception still is not thrown. I think the applet should behave as if it is not signed.
java.security.AccessControlException: access denied ("java.net.SocketPermission" "232.1.1.1" "connect,accept,resolve")


REGRESSION. Last worked in version 7

STEPS TO FOLLOW TO REPRODUCE THE PROBLEM :
1) create applet that opens a multicast socket
2) start the applet in a browser (does not matter which one)
3) java.security.AccessControlException: access denied ("java.net.SocketPermission" "232.1.1.1" "connect,accept,resolve")
gets thrown
4) Sign the applet with a self signed ceritificate
5) start the applet in a webbrowser and answer the certificate question with cancel. Security exception is not thrown.

EXPECTED VERSUS ACTUAL BEHAVIOR :
EXPECTED -
Security exception should get thrown when the cancel button is hit.
ACTUAL -
Security exception is not thrown

REPRODUCIBILITY :
This bug can be reproduced always.