public class PennTreebankTokenizer extends TokenizerAdapter
eolString, st
nextToken
Constructor and Description |
---|
PennTreebankTokenizer(Reader r) |
getNext, isEol, setEolString
hasNext, next, peek, remove, tokenize
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
forEachRemaining
public PennTreebankTokenizer(Reader r)