if (peerMap.get(target) == peer) {
        peerMap.remove(target);
        notifyPeerMapUpdated();
    }

Instead of separate get+remove calls we can use Map.remove(Key,Value) instead.
peerMap is an IdentityHashMap, so semantic is the same.