Remove all sym links from /usr/bin and remove installed JDK from /Library/Java/JavaVirtualMachines/.
When the JDK is installed from the pkg symlinks are not created in /usr/bin or in other public directories.