|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectedu.stanford.nlp.process.WordTokenFactory
public class WordTokenFactory
Constructs a Word from a String. This is the default TokenFactory for PTBLexer. It discards the positional information.
Constructor Summary | |
---|---|
WordTokenFactory()
|
Method Summary | |
---|---|
Word |
makeToken(java.lang.String str,
int begin,
int length)
Constructs a token (of arbitrary type) from a String and its position in the underlying text. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public WordTokenFactory()
Method Detail |
---|
public Word makeToken(java.lang.String str, int begin, int length)
LexedTokenFactory
makeToken
in interface LexedTokenFactory<Word>
str
- The String extracted by the lexer.begin
- The offset in the document of the first character
in this string.length
- The number of characters the string takes up in
the document.
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |