Following program tests StringTokenizer for all White Space charactors as an delimiter(Java Languagte Spec 20.5.19 for valid WhiteSpace charactors).

Current Implementation Ignores '\f' as white space charactor.

------8< --------- TestStrTknizer.java --------------------------------

import java.util.StringTokenizer;

public class TestStrTknizer {

  public static void main(String[] argv) {
    StringTokenizer st = new StringTokenizer("ABCDEFG\fHIJKLM PQR");
    while (st.hasMoreTokens()) {
      System.out.println("Token :" + st.nextToken());
    }
  }
}

---------------------------------------------------------------