public class WordTokenFactory extends Object implements LexedTokenFactory<Word>
Constructor and Description |
---|
WordTokenFactory() |
Modifier and Type | Method and Description |
---|---|
Word |
makeToken(String str,
int begin,
int length)
Constructs a token (of arbitrary type) from a String and its position
in the underlying text.
|
public Word makeToken(String str, int begin, int length)
LexedTokenFactory
str
.)makeToken
in interface LexedTokenFactory<Word>
str
- The String extracted by the lexer.begin
- The offset in the document of the first character
in this string.length
- The number of characters the string takes up in
the document.