SelectiveAWTEventListener selectiveListener =
                listener2SelectiveListener.get(localL);

            if (selectiveListener != null) {
                listener2SelectiveListener.remove(localL);

There is no need to call WeakHashMap.get + WeakHashMap.remove.
Instead we can call only remove and compare result with null.