public class WordTokenFactory extends java.lang.Object implements LexedTokenFactory<Word>
Constructor and Description |
---|
WordTokenFactory() |
public Word makeToken(java.lang.String str, int begin, int length)
LexedTokenFactory
str
.)makeToken
in interface LexedTokenFactory<Word>
str
- The String extracted by the lexer.begin
- The offset in the document of the first character
in this string.length
- The number of characters the string takes up in
the document.