public class TreeTokenizerFactory extends Object implements TokenizerFactory<Tree>
Constructor and Description |
---|
TreeTokenizerFactory(TreeReaderFactory trf)
Create a TreeTokenizerFactory from a TreeReaderFactory.
|
Modifier and Type | Method and Description |
---|---|
Iterator<Tree> |
getIterator(Reader r)
Same as getTokenizer().
|
Tokenizer<Tree> |
getTokenizer(Reader r)
Gets a tokenizer from a reader.
|
Tokenizer<Tree> |
getTokenizer(Reader r,
String extraOptions) |
void |
setOptions(String options) |
public TreeTokenizerFactory(TreeReaderFactory trf)
public Tokenizer<Tree> getTokenizer(Reader r)
getTokenizer
in interface TokenizerFactory<Tree>
public Tokenizer<Tree> getTokenizer(Reader r, String extraOptions)
getTokenizer
in interface TokenizerFactory<Tree>
public Iterator<Tree> getIterator(Reader r)
getIterator
in interface IteratorFromReaderFactory<Tree>
r
- Where to read objects frompublic void setOptions(String options)
setOptions
in interface TokenizerFactory<Tree>