public class LexerTokenizer extends AbstractTokenizer<String>
Tokenizer
designed to work with
Lexer
implementing classes. Throw in a Lexer
on
construction and you get a Tokenizer
.nextToken
Constructor and Description |
---|
LexerTokenizer(Lexer l) |
LexerTokenizer(Lexer l,
Reader r) |
Modifier and Type | Method and Description |
---|---|
protected String |
getNext()
Internally fetches the next token.
|
static void |
main(String[] args)
for testing only
|
hasNext, next, peek, remove, tokenize
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
forEachRemaining
public LexerTokenizer(Lexer l)
protected String getNext()
getNext
in class AbstractTokenizer<String>
public static void main(String[] args) throws IOException
IOException