public class TreeTokenizerFactory extends java.lang.Object implements TokenizerFactory<Tree>
Constructor and Description |
---|
TreeTokenizerFactory(TreeReaderFactory trf)
Create a TreeTokenizerFactory from a TreeReaderFactory.
|
Modifier and Type | Method and Description |
---|---|
java.util.Iterator<Tree> |
getIterator(java.io.Reader r)
Same as getTokenizer().
|
Tokenizer<Tree> |
getTokenizer(java.io.Reader r)
Gets a tokenizer from a reader.
|
Tokenizer<Tree> |
getTokenizer(java.io.Reader r,
java.lang.String extraOptions)
Get a tokenizer for this reader.
|
void |
setOptions(java.lang.String options)
Sets default options for how tokenizers built from this factory should behave.
|
public TreeTokenizerFactory(TreeReaderFactory trf)
public Tokenizer<Tree> getTokenizer(java.io.Reader r)
getTokenizer
in interface TokenizerFactory<Tree>
r
- A Reader (which is assumed to already by buffered, if appropriate)public Tokenizer<Tree> getTokenizer(java.io.Reader r, java.lang.String extraOptions)
TokenizerFactory
getTokenizer
in interface TokenizerFactory<Tree>
r
- A Reader (which is assumed to already by buffered, if appropriate)extraOptions
- Options for how this tokenizer should behavepublic java.util.Iterator<Tree> getIterator(java.io.Reader r)
getIterator
in interface IteratorFromReaderFactory<Tree>
r
- Where to read objects frompublic void setOptions(java.lang.String options)
TokenizerFactory
setOptions
in interface TokenizerFactory<Tree>
options
- Options for how this tokenizer should behave