[vector] Cleanup redundant bitwise cases on floating point vectors

Float/DoubleVector implementations contain redundant cases for bitwise operations. Such bitwise operations will fail on such FP vectors before the case is reached.